-- Logs begin at Fri 2022-09-16 07:15:51 UTC, end at Fri 2022-09-16 08:24:58 UTC. -- Sep 16 07:56:13.273891 dv-cinder-740146-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 16 07:56:13.283185 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 16 07:56:13.285180 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 07:56:13 2022] *** Sep 16 07:56:13.285180 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 07:56:13.285180 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 07:56:13.285180 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: nodename: dv-cinder-740146-20-iscsi Sep 16 07:56:13.285180 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: machine: x86_64 Sep 16 07:56:13.285180 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: clock source: unix Sep 16 07:56:13.285180 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: pcre jit disabled Sep 16 07:56:13.285180 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: detected number of CPU cores: 4 Sep 16 07:56:13.285180 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: current working directory: / Sep 16 07:56:13.285180 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: detected binary path: /usr/bin/uwsgi-core Sep 16 07:56:13.285180 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: your processes number limit is 47680 Sep 16 07:56:13.285943 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: your memory page size is 4096 bytes Sep 16 07:56:13.285943 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: detected max file descriptor number: 2048 Sep 16 07:56:13.285943 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: lock engine: pthread robust mutexes Sep 16 07:56:13.285943 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: thunder lock: enabled Sep 16 07:56:13.285943 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 16 07:56:13.285943 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 07:56:13.324560 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: Python main interpreter initialized at 0x5585b57fb9c0 Sep 16 07:56:13.324560 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: python threads support enabled Sep 16 07:56:13.324560 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: your server socket listen backlog is limited to 100 connections Sep 16 07:56:13.324560 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: your mercy for graceful operations on workers is 90 seconds Sep 16 07:56:13.324895 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 07:56:13.324970 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: *** Operational MODE: preforking *** Sep 16 07:56:13.325205 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: *** uWSGI is running in multiple interpreter mode *** Sep 16 07:56:13.325205 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: spawned uWSGI master process (pid: 106021) Sep 16 07:56:13.325399 dv-cinder-740146-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 16 07:56:13.326472 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: spawned uWSGI worker 1 (pid: 106022, cores: 1) Sep 16 07:56:13.326472 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: spawned uWSGI worker 2 (pid: 106023, cores: 1) Sep 16 07:56:13.326472 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 07:56:13.982446 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 07:56:13.985440 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 07:56:15.053448 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 07:56:15.053448 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: from cryptography.utils import int_from_bytes Sep 16 07:56:15.054043 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 07:56:15.054043 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: from cryptography.utils import int_from_bytes Sep 16 07:56:15.054402 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 07:56:15.054402 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: from cryptography.utils import int_from_bytes Sep 16 07:56:15.054860 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 07:56:15.054860 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: from cryptography.utils import int_from_bytes Sep 16 07:56:17.553630 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 07:56:17.554206 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 07:56:17.554390 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 07:56:17.554499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 07:56:17.554955 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 07:56:17.555046 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 07:56:17.555046 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 07:56:17.555220 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 07:56:17.555367 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.555535 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 07:56:17.555685 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.555779 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 07:56:17.556001 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.556156 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.556321 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.556480 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.556643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.556815 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.556974 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.557146 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.557316 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.557531 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.557840 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.557933 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.558152 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.558284 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.558416 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.558545 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.558710 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.558854 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.559031 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-20-iscsi {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.559166 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.559345 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.559484 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.559645 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.559777 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-20-iscsi {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.559948 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.560074 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.560257 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.560393 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.560554 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.560695 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.560867 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.560998 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.561163 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.561300 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.561476 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.561654 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.562125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.562255 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.562378 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.562502 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.562616 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.562759 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.562878 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.562996 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.563161 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.563293 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.563491 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.563626 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.563798 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.563934 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.564103 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.564237 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.564418 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.564553 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.564737 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.564941 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.565092 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.565303 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-20-iscsi {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.565506 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.565695 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.565880 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-20-iscsi {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.566071 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.566269 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.566462 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.566643 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.566853 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.567037 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.567247 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.567441 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.567626 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.567789 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.567984 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.568120 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.568283 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.568420 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.568559 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.568726 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.568858 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.569062 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.569197 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.569369 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.569501 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.569632 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.569764 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.569898 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.570030 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.570160 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.570284 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.570415 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.570553 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.570748 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.570888 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.571028 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.571153 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.571283 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.571420 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.571420 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.571661 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.571784 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.571906 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.571906 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.572147 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.572272 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.572393 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.572523 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.572652 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.572652 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.572907 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.573043 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.573168 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.573327 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.573487 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.573487 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.573739 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.573864 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.573994 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.574125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.574262 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.574386 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.574516 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.574639 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.574774 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.574897 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.575035 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.575167 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.575290 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.575447 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.575575 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.575747 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.575881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.576050 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.576186 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.576351 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.576477 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.576663 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.576799 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.576965 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.577097 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.577279 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.577410 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.577584 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.577718 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.577901 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.578035 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.578204 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.578338 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.578527 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.578661 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.578843 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.578968 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.579150 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.579275 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.579464 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.579592 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.579766 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.579891 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.580070 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.580200 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.580371 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.580506 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.580671 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.580795 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.580973 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.581108 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.581276 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.581419 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.581584 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.581709 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.581840 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.582021 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.582149 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.582324 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.582460 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.582590 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.582734 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.582877 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.583008 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.583173 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.583299 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.583489 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.583624 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.583791 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.583920 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.584094 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.584227 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.584396 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.584530 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.584694 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.584821 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.584996 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.585123 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.585298 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.585432 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.585599 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.585727 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.585899 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.586032 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.586199 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.586336 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.586502 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.586639 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.586846 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.586985 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.587151 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.587288 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.587455 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.587583 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.587753 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.587878 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.588566 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.588710 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.588870 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.589005 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.589171 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.589296 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.589474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.589610 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.589773 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.589900 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.590074 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.590198 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.590388 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.590521 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.590726 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.590857 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.590992 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.591121 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.591306 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.591449 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.591609 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.591733 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.591908 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.592034 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.592220 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.592353 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.592512 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.592647 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.592812 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.592938 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.593119 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.593251 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.593414 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.593539 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.593712 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.593844 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.594012 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.594149 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.594312 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.594440 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.594610 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.594764 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.594966 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.595101 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.595231 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.595356 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.595502 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.595629 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.595798 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.595933 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.596095 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.596228 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.596394 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.596530 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.596689 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.596818 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.596993 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.597117 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.597294 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.597431 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.597597 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.597721 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.597899 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.598027 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.598199 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.598336 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.598510 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 07:56:17.598651 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.598865 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.599004 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.599193 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.599332 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.599519 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.599647 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.599828 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.599953 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.600134 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.600260 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.600442 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.600570 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.600761 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.600889 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.601065 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.601195 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.601369 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.601495 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.601674 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.601807 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.601985 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.602111 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.602291 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.602425 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.602597 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.602759 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.602932 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.603059 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.603242 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.603377 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.603555 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.603679 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.604444 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.604580 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.604740 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.604869 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.605054 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.605187 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.605365 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.605501 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.605668 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.605802 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.605990 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.606125 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.606305 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.606440 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.606613 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.606795 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.606963 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.607099 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.607280 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.607414 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.607588 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.607716 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.607896 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.608036 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.608203 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.608330 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.608509 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.608634 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.608816 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.608952 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.609123 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.609250 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.609435 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.609560 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.609744 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.609873 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.610050 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.610174 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.610356 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.610487 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.610663 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.610812 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.610991 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.611117 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.611299 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.611427 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.611604 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.611737 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.611917 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.612043 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.612226 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.612354 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.612532 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.612667 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.612849 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.612975 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.613157 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.613293 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.613470 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.613597 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.613776 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.613902 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.614080 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.614219 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.614386 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.614512 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.614720 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.614851 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.615013 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.615156 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.615313 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.615433 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.615636 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.615764 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.615906 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.616054 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.616208 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.616335 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.616513 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.616641 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.616814 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.616951 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.617130 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.617284 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.617429 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.617555 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.617754 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.617888 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.618012 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.618144 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.618319 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.618453 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.618619 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.618779 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.618952 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.619080 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.619256 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.619381 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.619579 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.619706 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.619894 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.620019 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.620199 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.620326 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.620497 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.620623 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.620813 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.620942 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.621116 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.621252 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.621415 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.621540 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.621722 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.621854 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.622027 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.622167 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.622330 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.622465 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.622638 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.622810 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.622967 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.623103 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.623273 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.623400 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.623579 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.623706 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.623884 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.624020 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.624201 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.624327 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.624511 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.624639 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.624812 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.624938 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.625133 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.625259 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.625452 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.625580 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.625751 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.625924 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.626038 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.626165 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.626344 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.626471 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.626643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.626792 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.626964 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.627093 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.627262 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.627397 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.627561 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.627689 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.627855 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.627988 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.628152 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.628291 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.628448 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.628574 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.628743 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.628868 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.629038 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.629175 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.629335 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.629461 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.629635 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.629770 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.629933 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.630066 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.630231 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.630365 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.630528 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.630663 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.630851 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.630987 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.631154 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.631282 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.631451 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.631579 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.631789 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.631920 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.632089 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.632225 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.632412 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.632538 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.632721 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.632852 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.633031 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.633157 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.633334 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.633468 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.633638 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.633765 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.633947 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.634104 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.634236 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.634360 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.634537 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.634669 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.634865 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.635007 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.635196 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.635330 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.635499 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.635624 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.635802 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.635935 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.636109 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.636251 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.636411 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.636537 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.636714 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.636839 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.637020 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.637155 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.637334 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.637468 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.637632 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.637766 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.637940 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.638083 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.638260 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.638393 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.638567 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.638714 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.638901 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.639043 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.639207 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.639334 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.639510 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.639635 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.639813 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.639939 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.640117 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.640243 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.640424 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.640552 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.640725 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.640851 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.641027 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.641152 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.641329 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.641454 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.641632 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.641769 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.641935 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.642067 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.642241 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.642367 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.642536 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.642663 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.642868 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.642995 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.643179 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.643323 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.643477 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.643605 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.643786 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.643921 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.644090 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.644226 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.644405 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.644532 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.644709 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.644836 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.645011 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.645152 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.645317 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.645453 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.645615 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.645742 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.645912 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.646121 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.646237 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.646358 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.646504 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.646638 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.646831 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.646960 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.647136 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.647261 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.647435 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.647562 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.647739 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.647874 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.648040 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.648166 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.648337 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.648462 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.648633 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.648759 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.648935 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.649060 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.649234 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.649362 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.649534 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.649663 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.649841 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.649969 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.650152 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.650277 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.650452 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.651121 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.651294 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.651421 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.651614 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.651753 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.651919 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.652052 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.652217 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.652342 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.652516 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.652653 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.652816 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.652944 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.653115 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.653240 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.653416 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.653554 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.653717 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.653844 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.654033 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.654158 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.654347 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.654486 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.654647 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.654796 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.654977 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.655104 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.655285 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.655421 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.655589 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.655715 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.655901 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.656029 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.656206 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.656326 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.656511 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.656649 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.656814 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.656952 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.657119 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.657247 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.657488 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.657632 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.657757 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.657878 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.658015 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.658147 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.658321 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.658448 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.658624 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.658822 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.658956 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.659080 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.659239 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.659366 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.659547 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.659687 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.659851 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.659977 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.660151 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.660410 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.660538 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.660741 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.660869 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.661053 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.661300 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.661429 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.661632 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.661768 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.661952 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.662089 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.662270 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.662398 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.662609 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.662767 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.662942 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.663082 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.663244 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.663372 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.663554 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.663688 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.663860 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.663996 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.664159 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.664286 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.664463 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.664588 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.664760 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.664898 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.665060 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.665185 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.665360 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.665489 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.665658 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.665785 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.665955 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.666080 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.666785 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.666919 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.667095 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.667237 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.667395 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.667540 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.667697 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.667825 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.667995 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.668125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.668293 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.668419 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.668591 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.668716 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.668893 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.669020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.669199 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.669324 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.669498 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.669635 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.669796 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.669924 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.670094 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.670221 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.670392 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.670596 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.670744 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.670870 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.671004 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.671134 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.671343 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.671481 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.671644 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.671780 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.671984 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.672112 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.672282 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.672408 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.672603 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.672731 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.672905 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.673034 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.673207 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.673337 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.673505 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.673632 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.673809 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.673938 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.674106 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.674232 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.674400 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.674525 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.674725 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.674856 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.675033 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.675168 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.675331 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.675458 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.675902 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.676037 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.676203 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.676331 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.676506 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.676639 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.676801 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.676937 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.677097 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.677223 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.677401 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.677527 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.677698 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.677834 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.677993 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.678121 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.678293 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.678419 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.678591 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.678772 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.678900 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.679024 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.679204 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.679340 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.679498 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.679624 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.679792 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.679918 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.680093 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.680218 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.680387 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.680514 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.680682 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.680814 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.680982 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.681108 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.681281 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.681415 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.681577 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.681710 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.681903 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.682031 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.682209 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.682336 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.682508 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.682642 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.682829 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.682957 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.683134 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.683272 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.683432 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.683566 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.683730 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.683867 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.684034 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.684161 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.684350 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.684478 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.684648 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.684787 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.684946 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.685078 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.685249 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.685378 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.685546 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.685681 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.685844 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.685969 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.686140 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.686265 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.686439 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.686573 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.686756 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.686884 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.687053 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.687191 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.687352 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.687488 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.687648 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.687774 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.687945 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.688077 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.688240 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.688375 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.688539 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.688674 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.688834 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.688959 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.689134 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.689263 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.689430 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.689565 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.689726 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.689869 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.690026 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.690153 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.690323 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.690450 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.690661 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.690824 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.690983 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.691117 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.691299 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.691425 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.691606 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.691747 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.691912 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.692039 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.692221 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.692356 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.692521 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.692660 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.692824 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.692951 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.693128 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.693260 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.693425 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.693560 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.693721 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.693854 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.694018 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.694152 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.694324 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.694451 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.694625 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.694816 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.694941 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.695064 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.695254 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.695383 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.695563 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.695690 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.695869 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.695996 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.696166 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.696293 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.696471 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.696598 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.696776 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.696904 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.697079 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.697208 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.697381 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.698061 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.698220 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.698355 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.698523 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.698648 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.698852 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.698990 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.699156 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.699355 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.699482 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.699602 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.699753 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.699880 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.700055 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.700190 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.700358 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.700483 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.700661 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.700786 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.700960 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.701101 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.701263 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.701394 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.701568 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.701693 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.701865 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.701998 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.702169 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.702308 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.702466 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.702600 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.702784 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.702910 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.703080 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.703206 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.703377 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.703500 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.703683 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.703811 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.703984 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.704111 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.704369 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.704493 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.704675 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.704802 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.704980 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.705115 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.705278 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.705413 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.705583 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.705710 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.705881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.706005 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.706192 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.706326 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.706501 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.706626 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.706829 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.706967 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.707189 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.707323 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.707489 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.707627 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.707786 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.707912 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.708089 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.708224 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.708405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.708529 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.708700 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.708823 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.708998 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.709125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.709296 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.709430 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.709599 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.709724 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.709897 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.710025 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.710196 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.710322 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.710512 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.710637 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.710823 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.710927 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.711138 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.711230 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.711547 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.711660 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.711854 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.711956 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.712151 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.712240 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.712510 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.712607 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.712830 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.712929 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.713695 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.713791 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.714000 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.714086 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.714309 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.714407 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.714618 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.714728 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.714947 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.715035 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.715258 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.715364 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.715569 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.715708 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.715879 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.716015 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.716183 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.716330 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.716489 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.716615 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.716799 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.716928 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.717105 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.717242 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.717420 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.717545 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.717735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.717869 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.718045 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.718174 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.718363 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.718492 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.719155 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.719288 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.719411 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.719528 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.719635 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.719739 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.719845 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.719950 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.720064 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.720177 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.720285 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.720389 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.720494 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.720606 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.720804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.720921 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.721106 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.721221 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.721417 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.721540 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.721725 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.721839 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.722026 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.722140 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.722324 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.722447 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.722621 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.722771 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.722951 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.723077 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.723247 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.723374 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.723543 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.723656 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.723857 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.723977 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.724152 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.724290 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.724469 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.724604 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.724767 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.724894 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.725079 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.725208 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.725382 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.725507 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.725680 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.725807 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.725981 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.726119 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.726281 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.726408 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.726579 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.726725 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.726908 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.727038 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.727208 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.727337 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.727544 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.727676 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.727845 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.727982 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.728159 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.728286 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.728481 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.728609 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.728829 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.728964 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.729133 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.729259 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.729445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.729580 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.729759 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.729894 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.730072 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.730199 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.730372 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.730508 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.730673 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.730819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.731000 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.731128 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.731307 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.731448 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.731603 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.731729 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.731901 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.732027 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.732197 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.732332 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.732494 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.732620 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.732789 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.732916 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.733085 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.733219 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.733379 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.733507 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.733674 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.733802 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.733971 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.734094 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.734288 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.734415 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.734586 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.734766 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.734898 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.735004 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.735197 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.735321 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.735511 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.735640 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.735811 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.735926 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.736110 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.736225 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.736429 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.736551 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.736731 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.736852 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.737051 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.737176 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.737354 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.737476 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.737666 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.737779 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.737975 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.738088 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.738270 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.738449 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.738584 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.738721 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.738918 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.739035 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.739226 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.739348 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.739986 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.740114 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.740248 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.740383 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.740510 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.740641 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.740767 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.740900 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.741026 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.741158 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.741284 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.741407 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.741538 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.741663 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.741832 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.741974 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.742142 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.742277 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.742447 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.742572 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.742776 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.742910 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.743085 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.743213 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.743391 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.743524 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.743694 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.743823 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.743998 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.744117 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.744327 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.744458 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.744636 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.744765 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.744961 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.745089 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.745281 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.745422 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.745596 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.745722 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.745907 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.746034 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.746219 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.746356 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.746528 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.746654 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.746872 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.747012 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.747185 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.747315 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.747537 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.747676 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.747844 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.747978 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.748145 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.748280 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.748452 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.748578 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.748758 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.748898 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.749066 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.749193 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.749372 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.749498 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.749716 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.749851 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.750034 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.750169 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.750345 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.750483 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.750653 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.750810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.750993 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.751120 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.751304 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.751434 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.751615 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.751752 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.751922 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.752048 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.752231 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.752359 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.752541 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.752669 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.752851 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.753054 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.753181 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.753366 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.753504 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.753694 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.753958 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.754086 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.754270 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.754397 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.754600 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.754769 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.754943 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.755071 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.755262 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.755402 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.755562 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.755689 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.755863 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.755992 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.756171 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.756312 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.756472 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.756599 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.756768 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.756886 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.757078 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.757216 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.757383 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.757514 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.757680 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.757808 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.757992 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.758127 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.758297 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.758433 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.758594 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.758845 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.758985 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.759190 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.759319 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.759505 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.759738 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.759875 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.760609 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.760741 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.760925 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.761054 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.761246 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.761374 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.761567 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.761697 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.761867 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.761997 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.762168 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.762337 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.762473 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.762597 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.762789 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.762920 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.763092 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.763229 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.763393 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.763520 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.763697 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.763823 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.763998 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.764135 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.764295 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.764421 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.764602 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.764730 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.764900 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.765039 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.765199 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.765331 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.765505 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.765630 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.765801 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.765935 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.766099 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.766233 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.766405 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.766540 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.766725 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.766857 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.767026 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.767153 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.767326 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.767455 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.767660 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.767795 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.767929 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.768053 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.768178 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.768302 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.768480 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.768609 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.768775 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.768902 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.769072 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.769198 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.769378 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.769507 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.769677 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.769796 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.769982 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.770118 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.770295 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.770421 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.770595 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.770768 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.770919 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.771060 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.771236 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.771394 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.771526 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.771658 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.771820 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.771958 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.772133 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.772261 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.772436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.772563 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.772750 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.772885 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.773058 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.773193 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.773364 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.773588 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.773730 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.773915 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.774044 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.774232 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.774513 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.774648 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.774876 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.775007 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.775191 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.775317 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.775494 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.775666 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.776353 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.776491 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.776673 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.776801 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.776973 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.777105 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.777274 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.777403 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.777577 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.777704 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.777883 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.778020 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.778188 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.778314 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.778490 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.778624 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.778818 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.778966 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.779125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.779250 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.779428 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.779553 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.779730 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.779860 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.780033 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.780160 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.780336 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.780461 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.780636 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.780771 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.780938 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.781064 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.781242 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.781370 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.781546 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.781687 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.781883 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.782041 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.782176 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.782308 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.782468 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.782603 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.782802 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.782940 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.783108 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.783245 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.783414 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.783549 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.783719 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.783857 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.784022 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.784163 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.784333 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.784468 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.784656 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.784786 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.784965 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.785102 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.785265 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.785394 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.785586 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.785901 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.786037 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.786202 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.786329 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.786540 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.786889 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.787032 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.787200 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.787331 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.787519 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.787647 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.787834 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.787968 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.788140 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.788268 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.788458 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.788586 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.788766 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.788902 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.789071 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.789198 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.789390 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.789527 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.789699 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.789840 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.790024 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.790160 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.790325 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.790451 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.790629 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.790788 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.790954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.791090 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.791299 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.791428 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.791604 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.791739 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.791906 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.792033 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.792203 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.792330 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.792504 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.792640 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.792804 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.792931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.793102 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.793230 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.793398 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.793526 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.793694 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.793820 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.793990 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.794117 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.794289 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.794431 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.794564 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.794743 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.794882 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.795009 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.795182 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.795311 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.795477 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.795608 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.795771 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.795906 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.796067 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.796193 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.796364 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.796492 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.796658 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.796857 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.796993 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.797117 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.797240 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.797353 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.797525 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.797664 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.797821 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.797947 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.798117 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.798244 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.798413 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.798544 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.798729 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.798860 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.799058 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.799187 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.799373 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.799501 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.799684 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.799817 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.799986 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.800106 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.800296 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.800424 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.800881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.801008 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.801184 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.801311 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.801492 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.801621 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.801808 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.801934 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.802115 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.802254 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.802419 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.802546 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.802748 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.802879 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.803056 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.803197 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.803362 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.803491 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.803714 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.803852 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.803977 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.804112 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.804267 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.804396 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.804574 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.804703 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.804892 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.805027 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.805205 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.805334 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.805505 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.805638 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.805819 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.805948 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.806127 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.806255 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.806439 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.806565 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.806793 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.806925 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.807107 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.807233 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.807415 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.807543 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.807725 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.807855 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.808031 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.808165 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.808341 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.808477 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.808646 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.808772 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.808950 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.809077 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.809263 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.809397 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.809567 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.809694 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.809875 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.810003 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.810190 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.810328 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.810501 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.810627 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.810848 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.810977 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.811173 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.811303 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.811518 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.811654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.811828 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.811955 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.812147 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.812276 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.812477 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.812603 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.812788 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.812921 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.813094 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.813224 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.813396 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.813530 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.813655 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106023) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 07:56:17.813793 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.814027 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.814328 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 07:56:17.814568 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=106022) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 07:56:17.967353 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO dbcounter [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Registered counter for database nova_api Sep 16 07:56:17.967554 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO dbcounter [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Registered counter for database nova_api Sep 16 07:56:17.989063 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_db.sqlalchemy.engines [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 07:56:17.991589 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG oslo_db.sqlalchemy.engines [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 07:56:17.995700 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writer thread running {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 07:56:17.998147 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG dbcounter [-] [106022] Writer thread running {{(pid=106022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 07:56:18.051655 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.context [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43(cell1) {{(pid=106023) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 07:56:18.054299 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.context [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43(cell1) {{(pid=106022) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 07:56:18.055599 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 07:56:18.056078 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 07:56:18.058195 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 07:56:18.058647 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG oslo_concurrency.lockutils [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 07:56:18.058942 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 07:56:18.059154 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG oslo_concurrency.lockutils [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 07:56:18.059378 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 07:56:18.060705 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG oslo_concurrency.lockutils [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 07:56:18.061319 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 07:56:18.061435 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG oslo_concurrency.lockutils [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 07:56:18.061854 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG oslo_concurrency.lockutils [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 07:56:18.063307 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO dbcounter [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Registered counter for database nova_cell0 Sep 16 07:56:18.063894 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG oslo_concurrency.lockutils [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=106022) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 07:56:18.065976 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO dbcounter [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Registered counter for database nova_cell0 Sep 16 07:56:18.067301 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO dbcounter [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Registered counter for database nova_cell1 Sep 16 07:56:18.070082 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO dbcounter [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Registered counter for database nova_cell1 Sep 16 07:56:18.075561 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_db.sqlalchemy.engines [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 07:56:18.076738 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_db.sqlalchemy.engines [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 07:56:18.079040 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG oslo_db.sqlalchemy.engines [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 07:56:18.080684 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG oslo_db.sqlalchemy.engines [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 07:56:18.083418 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writer thread running {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 07:56:18.084870 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writer thread running {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 07:56:18.085676 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG dbcounter [-] [106022] Writer thread running {{(pid=106022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 07:56:18.223643 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG dbcounter [-] [106022] Writer thread running {{(pid=106022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 07:56:18.228473 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO dbcounter [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Registered counter for database nova_cell0 Sep 16 07:56:18.234393 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO dbcounter [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Registered counter for database nova_cell0 Sep 16 07:56:18.238047 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_db.sqlalchemy.engines [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106023) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 07:56:18.242375 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writer thread running {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 07:56:18.242916 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG oslo_db.sqlalchemy.engines [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=106022) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 07:56:18.247715 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG dbcounter [-] [106022] Writer thread running {{(pid=106022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 07:56:18.668636 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: WARNING keystonemiddleware.auth_token [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 07:56:18.676082 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: WARNING keystonemiddleware.auth_token [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 07:56:18.790402 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: WARNING keystonemiddleware.auth_token [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 07:56:18.798317 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: WARNING keystonemiddleware.auth_token [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 07:56:19.011743 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: WARNING keystonemiddleware.auth_token [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 07:56:19.017972 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: WARNING keystonemiddleware.auth_token [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 07:56:19.023454 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585b57fb9c0 pid: 106023 (default app) Sep 16 07:56:19.026226 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:56:19.027451 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] 10.222.0.59 "GET /compute/v2.1/" status: 200 len: 388 microversion: 2.1 time: 0.002439 Sep 16 07:56:19.027871 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 1/1] 10.222.0.59 () {50 vars in 788 bytes} [Fri Sep 16 07:56:19 2022] GET /compute/v2.1/ => generated 388 bytes in 4 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:56:19.137674 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: WARNING keystonemiddleware.auth_token [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 07:56:19.143719 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: WARNING keystonemiddleware.auth_token [None req-10a7c28b-a8cf-4d28-9ceb-2505827c644a None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 07:56:19.148946 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x5585b57fb9c0 pid: 106022 (default app) Sep 16 07:57:42.168742 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:57:42.169684 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 16 07:57:42.170091 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 2/2] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:57:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:57:42.182756 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG dbcounter [-] [106022] Writing DB stats nova_api:SELECT=3 {{(pid=106022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:42.183861 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG dbcounter [-] [106022] Writing DB stats nova_cell0:SELECT=3 {{(pid=106022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:42.184557 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG dbcounter [-] [106022] Writing DB stats nova_cell1:SELECT=3 {{(pid=106022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:42.187090 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG dbcounter [-] [106022] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:43.063897 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-e639abf0-2d1b-4edf-a854-51a8ce1491c0 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:57:43.097526 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-e639abf0-2d1b-4edf-a854-51a8ce1491c0 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 15 microversion: 2.61 time: 0.920365 Sep 16 07:57:43.098254 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 1/3] 10.222.0.59 () {60 vars in 1292 bytes} [Fri Sep 16 07:57:42 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 15 bytes in 922 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 07:57:45.722342 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:57:45.722342 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-ecc22419-e7aa-4490-99ef-110df06495e1 None None] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001438 Sep 16 07:57:45.722342 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 3/4] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:57:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:57:46.187866 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-0424f815-6d85-4ead-af66-8f55b3d06f8f admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "cirros256", "os-flavor-access:is_public": true, "rxtx_factor": 1.0, "swap": 0, "ram": 256, "vcpus": 1, "OS-FLV-EXT-DATA:ephemeral": 0, "disk": 1, "id": "c1"}} {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:57:46.283424 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-0424f815-6d85-4ead-af66-8f55b3d06f8f admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.61 time: 0.553673 Sep 16 07:57:46.284166 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 2/5] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Sep 16 07:57:45 2022] POST /compute/v2.1/flavors => generated 407 bytes in 555 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 07:57:46.297699 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writing DB stats nova_api:SELECT=3 {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:46.298865 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writing DB stats nova_cell0:SELECT=3 {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:46.300706 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writing DB stats nova_cell1:SELECT=3 {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:46.301738 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writing DB stats nova_cell0:SELECT=6,nova_cell0:INSERT=1 {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:57:46.503635 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-93aabd2f-cb1d-470e-b4bd-28b288370fd1 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:57:46.624217 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-93aabd2f-cb1d-470e-b4bd-28b288370fd1 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/c1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.331805 Sep 16 07:57:46.624800 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 4/6] 10.222.0.59 () {64 vars in 1336 bytes} [Fri Sep 16 07:57:46 2022] POST /compute/v2.1/flavors/c1/os-extra_specs => generated 43 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 07:57:49.234541 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-0424f815-6d85-4ead-af66-8f55b3d06f8f admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:57:49.235662 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-0424f815-6d85-4ead-af66-8f55b3d06f8f admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001570 Sep 16 07:57:49.236078 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 3/7] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:57:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:57:49.889195 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-52783c5c-1736-4e78-9e57-986acc829a90 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "swap": 0, "rxtx_factor": 1.0, "name": "ds512M", "vcpus": 1, "ram": 512, "disk": 5, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d1"}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:57:49.999815 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-52783c5c-1736-4e78-9e57-986acc829a90 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.757432 Sep 16 07:57:50.000374 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 5/8] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Sep 16 07:57:49 2022] POST /compute/v2.1/flavors => generated 404 bytes in 759 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 07:57:50.013147 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-285795fc-d608-4a5c-a993-66553892fe47 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:57:50.123741 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-285795fc-d608-4a5c-a993-66553892fe47 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.114562 Sep 16 07:57:50.124443 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 4/9] 10.222.0.59 () {64 vars in 1336 bytes} [Fri Sep 16 07:57:50 2022] POST /compute/v2.1/flavors/d1/os-extra_specs => generated 43 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 07:57:52.704083 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-52783c5c-1736-4e78-9e57-986acc829a90 admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:57:52.705355 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-52783c5c-1736-4e78-9e57-986acc829a90 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001876 Sep 16 07:57:52.705779 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 6/10] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:57:52 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:57:53.116846 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-fc61ff24-1f61-4ee4-9cec-20a71953add5 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "name": "ds1G", "disk": 10, "swap": 0, "id": "d2", "vcpus": 1, "ram": 1024}} {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:57:53.187903 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-fc61ff24-1f61-4ee4-9cec-20a71953add5 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.475035 Sep 16 07:57:53.188571 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 5/11] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Sep 16 07:57:52 2022] POST /compute/v2.1/flavors => generated 404 bytes in 476 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 07:57:53.205056 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-9142d237-ae20-4da9-a702-7b1b9159674e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:57:53.283532 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-9142d237-ae20-4da9-a702-7b1b9159674e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.085898 Sep 16 07:57:53.284307 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 7/12] 10.222.0.59 () {64 vars in 1336 bytes} [Fri Sep 16 07:57:53 2022] POST /compute/v2.1/flavors/d2/os-extra_specs => generated 43 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 07:57:55.881279 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-fc61ff24-1f61-4ee4-9cec-20a71953add5 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:57:55.882215 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-fc61ff24-1f61-4ee4-9cec-20a71953add5 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001451 Sep 16 07:57:55.882623 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 6/13] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:57:55 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:57:56.294090 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-ad478034-b6c7-4f97-b5a4-7c4018aea50a admin admin] Action: 'create', calling method: >, body: {"flavor": {"vcpus": 2, "os-flavor-access:is_public": true, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "d3", "name": "ds2G", "ram": 2048, "swap": 0, "rxtx_factor": 1.0, "disk": 10}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:57:56.381176 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-ad478034-b6c7-4f97-b5a4-7c4018aea50a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.492021 Sep 16 07:57:56.382785 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 8/14] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Sep 16 07:57:55 2022] POST /compute/v2.1/flavors => generated 404 bytes in 493 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 07:57:56.395148 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-ce656526-f696-4715-bca3-3b6111b00f39 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:57:56.602757 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-ce656526-f696-4715-bca3-3b6111b00f39 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.211328 Sep 16 07:57:56.603616 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 7/15] 10.222.0.59 () {64 vars in 1336 bytes} [Fri Sep 16 07:57:56 2022] POST /compute/v2.1/flavors/d3/os-extra_specs => generated 43 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 07:57:59.186880 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-ad478034-b6c7-4f97-b5a4-7c4018aea50a admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:57:59.188223 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-ad478034-b6c7-4f97-b5a4-7c4018aea50a admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002003 Sep 16 07:57:59.188808 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 9/16] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:57:59 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:57:59.618368 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-0200a6a5-9963-460c-88ef-18c89f95cef7 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 4, "ram": 4096, "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "name": "ds4G", "swap": 0, "id": "d4", "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:57:59.701183 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-0200a6a5-9963-460c-88ef-18c89f95cef7 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.61 time: 0.506309 Sep 16 07:57:59.701748 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 8/17] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Sep 16 07:57:59 2022] POST /compute/v2.1/flavors => generated 404 bytes in 507 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 07:57:59.715255 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-47791e52-d489-4352-b69c-abd91595cf09 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:57:59.791859 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-47791e52-d489-4352-b69c-abd91595cf09 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/d4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081481 Sep 16 07:57:59.792634 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 10/18] 10.222.0.59 () {64 vars in 1336 bytes} [Fri Sep 16 07:57:59 2022] POST /compute/v2.1/flavors/d4/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 07:58:02.770233 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-0200a6a5-9963-460c-88ef-18c89f95cef7 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:02.771291 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-0200a6a5-9963-460c-88ef-18c89f95cef7 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 16 07:58:02.771701 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 9/19] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:58:02 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:03.183887 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-21a29875-4c7a-4a11-b0df-b39fc508e63c admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:03.213047 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-21a29875-4c7a-4a11-b0df-b39fc508e63c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 2106 microversion: 2.61 time: 0.434886 Sep 16 07:58:03.213589 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 11/20] 10.222.0.59 () {60 vars in 1292 bytes} [Fri Sep 16 07:58:02 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 2106 bytes in 436 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 07:58:05.781708 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-0200a6a5-9963-460c-88ef-18c89f95cef7 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:05.782913 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-0200a6a5-9963-460c-88ef-18c89f95cef7 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001689 Sep 16 07:58:05.783838 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 10/21] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:58:05 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:06.197634 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-619f1d07-1709-4b8a-9661-67dff0a97ea1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"os-flavor-access:is_public": true, "vcpus": 1, "disk": 1, "id": "1", "ram": 512, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "swap": 0, "name": "m1.tiny"}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:06.283974 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-619f1d07-1709-4b8a-9661-67dff0a97ea1 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 402 microversion: 2.61 time: 0.493265 Sep 16 07:58:06.284525 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 12/22] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Sep 16 07:58:05 2022] POST /compute/v2.1/flavors => generated 402 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 07:58:06.296527 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-ddabc907-0b31-42bc-a4eb-81059586543e admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:06.374244 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-ddabc907-0b31-42bc-a4eb-81059586543e admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/1/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081332 Sep 16 07:58:06.374776 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 11/23] 10.222.0.59 () {64 vars in 1333 bytes} [Fri Sep 16 07:58:06 2022] POST /compute/v2.1/flavors/1/os-extra_specs => generated 43 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 07:58:08.949144 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-619f1d07-1709-4b8a-9661-67dff0a97ea1 admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:08.950165 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-619f1d07-1709-4b8a-9661-67dff0a97ea1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001428 Sep 16 07:58:08.950575 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 13/24] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:58:08 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:09.298196 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-ea0a1cc7-70b8-468a-a3d2-fea8b5dd5b76 admin admin] Action: 'create', calling method: >, body: {"flavor": {"disk": 20, "vcpus": 1, "name": "m1.small", "swap": 0, "ram": 2048, "OS-FLV-EXT-DATA:ephemeral": 0, "id": "2", "os-flavor-access:is_public": true, "rxtx_factor": 1.0}} {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:09.369522 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-ea0a1cc7-70b8-468a-a3d2-fea8b5dd5b76 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.412438 Sep 16 07:58:09.369739 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 12/25] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Sep 16 07:58:08 2022] POST /compute/v2.1/flavors => generated 405 bytes in 414 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 07:58:09.386825 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-b0975537-3de4-4f02-8321-c8bb54beaa4c admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:09.469644 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-b0975537-3de4-4f02-8321-c8bb54beaa4c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/2/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.091829 Sep 16 07:58:09.470512 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 14/26] 10.222.0.59 () {64 vars in 1333 bytes} [Fri Sep 16 07:58:09 2022] POST /compute/v2.1/flavors/2/os-extra_specs => generated 43 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 07:58:12.198977 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-ea0a1cc7-70b8-468a-a3d2-fea8b5dd5b76 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:12.200889 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-ea0a1cc7-70b8-468a-a3d2-fea8b5dd5b76 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.002728 Sep 16 07:58:12.210765 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 13/27] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:58:12 2022] GET /compute/v2.1 => generated 388 bytes in 9 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:12.662022 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-406e31fd-7e3d-408e-8999-b27da8fc7b95 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.medium", "ram": 4096, "vcpus": 2, "id": "3", "swap": 0, "disk": 40, "rxtx_factor": 1.0, "OS-FLV-EXT-DATA:ephemeral": 0, "os-flavor-access:is_public": true}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:12.748113 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-406e31fd-7e3d-408e-8999-b27da8fc7b95 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 406 microversion: 2.61 time: 0.536769 Sep 16 07:58:12.748113 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 15/28] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Sep 16 07:58:12 2022] POST /compute/v2.1/flavors => generated 406 bytes in 540 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 07:58:12.761488 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-9fb641b4-854c-450d-be7f-2818210aa695 admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:12.768000 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG dbcounter [-] [106022] Writing DB stats nova_api:SELECT=33,nova_api:INSERT=7,nova_api:SAVEPOINT=3,nova_api:RELEASE=3 {{(pid=106022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:58:12.870625 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-9fb641b4-854c-450d-be7f-2818210aa695 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/3/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.113361 Sep 16 07:58:12.871592 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 14/29] 10.222.0.59 () {64 vars in 1333 bytes} [Fri Sep 16 07:58:12 2022] POST /compute/v2.1/flavors/3/os-extra_specs => generated 43 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 07:58:15.476757 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-406e31fd-7e3d-408e-8999-b27da8fc7b95 admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:15.477768 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-406e31fd-7e3d-408e-8999-b27da8fc7b95 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001975 Sep 16 07:58:15.478432 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 16/30] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:58:15 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:15.926609 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-e3bf7ce5-5b3a-4d1a-bad4-c438b343f8d1 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.large", "ram": 8192, "rxtx_factor": 1.0, "swap": 0, "disk": 80, "OS-FLV-EXT-DATA:ephemeral": 0, "vcpus": 4, "id": "4", "os-flavor-access:is_public": true}} {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:16.003070 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-e3bf7ce5-5b3a-4d1a-bad4-c438b343f8d1 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.61 time: 0.518417 Sep 16 07:58:16.003627 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 15/31] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Sep 16 07:58:15 2022] POST /compute/v2.1/flavors => generated 405 bytes in 520 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 07:58:16.016456 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-38fe9de1-9889-4b09-98cc-374516b49b3b admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:16.094726 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-38fe9de1-9889-4b09-98cc-374516b49b3b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/4/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.081759 Sep 16 07:58:16.103290 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 17/32] 10.222.0.59 () {64 vars in 1333 bytes} [Fri Sep 16 07:58:16 2022] POST /compute/v2.1/flavors/4/os-extra_specs => generated 43 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 07:58:18.717703 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-e3bf7ce5-5b3a-4d1a-bad4-c438b343f8d1 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:18.718761 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-e3bf7ce5-5b3a-4d1a-bad4-c438b343f8d1 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001467 Sep 16 07:58:18.719176 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 16/33] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:58:18 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:19.146183 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-e7e57ecf-8529-4f2c-a7af-2d7b0923661b admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.xlarge", "rxtx_factor": 1.0, "os-flavor-access:is_public": true, "id": "5", "vcpus": 8, "ram": 16384, "swap": 0, "disk": 160, "OS-FLV-EXT-DATA:ephemeral": 0}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:19.154770 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writing DB stats nova_api:SELECT=45,nova_api:SAVEPOINT=5,nova_api:INSERT=9,nova_api:RELEASE=5 {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:58:19.254670 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-e7e57ecf-8529-4f2c-a7af-2d7b0923661b admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 408 microversion: 2.61 time: 0.529131 Sep 16 07:58:19.255248 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 18/34] 10.222.0.59 () {64 vars in 1283 bytes} [Fri Sep 16 07:58:18 2022] POST /compute/v2.1/flavors => generated 408 bytes in 530 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 07:58:19.267829 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-18dca0ae-25da-4a92-bd36-a8e8651faafe admin admin] Action: 'create', calling method: >, body: {"extra_specs": {"hw_rng:allowed": "True"}} {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:19.361617 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-18dca0ae-25da-4a92-bd36-a8e8651faafe admin admin] 10.222.0.59 "POST /compute/v2.1/flavors/5/os-extra_specs" status: 200 len: 43 microversion: 2.61 time: 0.097453 Sep 16 07:58:19.362604 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 17/35] 10.222.0.59 () {64 vars in 1333 bytes} [Fri Sep 16 07:58:19 2022] POST /compute/v2.1/flavors/5/os-extra_specs => generated 43 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 07:58:36.835175 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-e7e57ecf-8529-4f2c-a7af-2d7b0923661b admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:36.836220 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-e7e57ecf-8529-4f2c-a7af-2d7b0923661b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001505 Sep 16 07:58:36.836620 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 19/36] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:58:36 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:36.847138 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG dbcounter [-] [106022] Writing DB stats nova_api:SELECT=14,nova_api:SAVEPOINT=2,nova_api:INSERT=3,nova_api:RELEASE=2 {{(pid=106022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:58:37.221458 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-b8b3d76c-dc4c-4613-b67c-255343b6af8e admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:37.239738 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-b8b3d76c-dc4c-4613-b67c-255343b6af8e admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 4202 microversion: 2.61 time: 0.397070 Sep 16 07:58:37.240272 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 18/37] 10.222.0.59 () {60 vars in 1292 bytes} [Fri Sep 16 07:58:36 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 4202 bytes in 398 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 07:58:38.538545 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-e7e57ecf-8529-4f2c-a7af-2d7b0923661b admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:38.539587 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-e7e57ecf-8529-4f2c-a7af-2d7b0923661b admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001481 Sep 16 07:58:38.539985 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 20/38] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Sep 16 07:58:38 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:39.057549 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-1c562e38-d681-4a76-bad5-ea26ebdc6778 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:39.062739 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.wsgi [None req-1c562e38-d681-4a76-bad5-ea26ebdc6778 admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-1c562e38-d681-4a76-bad5-ea26ebdc6778 admin admin] Request method failure captured: Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Accept: application/json Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Accept-Encoding: gzip, deflate Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Connection: keep-alive Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Content-Length: 0 Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Host: 10.222.0.59 Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Openstack-Api-Version: compute 2.92 Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Openstack-System-Scope: None Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: User-Agent: python-novaclient Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Auth-Token: gAAAAABjJCyuRELL5tlvmsBH08LNvBuW2zgvKnSh_QE5jUOztD2sxCf7BhBQRlkb4Qd83lk9zK4cKqMbUk6YATcXdW6_rpX6wvJgVc0sRFQUXU01u2-4eROWJz6OS5ubhjd1bDUJsC9yV1kVUkWNV1LvWhAQG3-SRvx7JVP4tbJov9MKVYzZcuM Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Domain-Id: None Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Domain-Name: None Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Identity-Status: Confirmed Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Is-Admin-Project: True Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Project-Domain-Id: default Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Project-Domain-Name: Default Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Project-Id: 1dfa255cacf3473b9f6619fec53b8cf1 Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Project-Name: admin Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Role: member,reader,admin Sep 16 07:58:39.065954 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Roles: member,reader,admin Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1dfa255cacf3473b9f6619fec53b8cf1", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Tenant: admin Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Tenant-Id: 1dfa255cacf3473b9f6619fec53b8cf1 Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Tenant-Name: admin Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User: admin Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User-Domain-Id: default Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User-Domain-Name: Default Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User-Id: 4763f3bdfee74904a41057be46f076ed Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User-Name: admin Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: method: > Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: exception: Flavor 42 could not be found. Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: action_args: {'id': '42'} Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 07:58:39.067654 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 07:58:39.068735 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:39.070125 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-1c562e38-d681-4a76-bad5-ea26ebdc6778 admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 07:58:39.072055 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-1c562e38-d681-4a76-bad5-ea26ebdc6778 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.390277 Sep 16 07:58:39.072055 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 19/39] 10.222.0.59 () {60 vars in 1190 bytes} [Fri Sep 16 07:58:38 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 391 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 07:58:39.078067 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-bbecb099-3d39-4ad5-b936-8405eb16d7b7 admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:39.099941 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-bbecb099-3d39-4ad5-b936-8405eb16d7b7 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.025792 Sep 16 07:58:39.100637 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 21/40] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Sep 16 07:58:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 27 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 07:58:39.110936 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-171ef8bf-7b44-4b46-a094-2c6ebf77da26 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:39.132903 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-171ef8bf-7b44-4b46-a094-2c6ebf77da26 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.026418 Sep 16 07:58:39.133466 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 20/41] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Sep 16 07:58:39 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 28 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 07:58:39.142849 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-1b145324-d5ab-48db-b005-359fa2e52e9d admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:39.148080 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.wsgi [None req-1b145324-d5ab-48db-b005-359fa2e52e9d admin admin] HTTP exception thrown: Flavor 42 could not be found. Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-1b145324-d5ab-48db-b005-359fa2e52e9d admin admin] Request method failure captured: Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: request: GET /compute/v2.1/flavors/42 HTTP/1.1 Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Accept: application/json Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Accept-Encoding: gzip, deflate Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Connection: keep-alive Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Content-Length: 0 Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Host: 10.222.0.59 Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Openstack-Api-Version: compute 2.92 Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Openstack-System-Scope: None Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: User-Agent: python-novaclient Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Auth-Token: gAAAAABjJCyuRELL5tlvmsBH08LNvBuW2zgvKnSh_QE5jUOztD2sxCf7BhBQRlkb4Qd83lk9zK4cKqMbUk6YATcXdW6_rpX6wvJgVc0sRFQUXU01u2-4eROWJz6OS5ubhjd1bDUJsC9yV1kVUkWNV1LvWhAQG3-SRvx7JVP4tbJov9MKVYzZcuM Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Domain-Id: None Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Domain-Name: None Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Identity-Status: Confirmed Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Is-Admin-Project: True Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Project-Domain-Id: default Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Project-Domain-Name: Default Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Project-Id: 1dfa255cacf3473b9f6619fec53b8cf1 Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Project-Name: admin Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Role: member,reader,admin Sep 16 07:58:39.151804 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Roles: member,reader,admin Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1dfa255cacf3473b9f6619fec53b8cf1", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Tenant: admin Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Tenant-Id: 1dfa255cacf3473b9f6619fec53b8cf1 Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Tenant-Name: admin Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User: admin Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User-Domain-Id: default Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User-Domain-Name: Default Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User-Id: 4763f3bdfee74904a41057be46f076ed Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User-Name: admin Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: method: > Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: exception: Flavor 42 could not be found. Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: action_args: {'id': '42'} Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 07:58:39.157643 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 42 could not be found. Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 07:58:39.158631 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 42 could not be found. Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 42 could not be found. Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:39.160020 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-1b145324-d5ab-48db-b005-359fa2e52e9d admin admin] Returning 404 to user: Flavor 42 could not be found. {{(pid=106023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 07:58:39.161267 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-1b145324-d5ab-48db-b005-359fa2e52e9d admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42" status: 404 len: 75 microversion: 2.92 time: 0.014205 Sep 16 07:58:39.161267 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 22/42] 10.222.0.59 () {60 vars in 1190 bytes} [Fri Sep 16 07:58:39 2022] GET /compute/v2.1/flavors/42 => generated 75 bytes in 15 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 07:58:40.360186 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-171ef8bf-7b44-4b46-a094-2c6ebf77da26 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:40.361269 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-171ef8bf-7b44-4b46-a094-2c6ebf77da26 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001532 Sep 16 07:58:40.361668 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 21/43] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Sep 16 07:58:40 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:40.884871 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-0f5c8404-ef76-4eb0-a042-63a630521bd4 admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:40.889832 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.wsgi [None req-0f5c8404-ef76-4eb0-a042-63a630521bd4 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-0f5c8404-ef76-4eb0-a042-63a630521bd4 admin admin] Request method failure captured: Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Accept: application/json Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Accept-Encoding: gzip, deflate Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Connection: keep-alive Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Content-Length: 0 Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Host: 10.222.0.59 Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Openstack-Api-Version: compute 2.92 Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Openstack-System-Scope: None Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: User-Agent: python-novaclient Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Auth-Token: gAAAAABjJCywelqHqEFJOXWg_qiXjOu8LwEze7Oigaam15IMuHPE3mQ6G5YMi4pMr4IZJ0lMIQiIp_gUM1f-x2GODtqRaJbfRcSXnJ4ZRwWSRD-TaGd3U_-2Dk5la76UwBasTadfWYRrzIAK4Yi8xhtgMf10JL3Wd0ogE_IUb5_KCagGDZY1S0c Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Domain-Id: None Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Domain-Name: None Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Identity-Status: Confirmed Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Is-Admin-Project: True Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Project-Domain-Id: default Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Project-Domain-Name: Default Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Project-Id: 1dfa255cacf3473b9f6619fec53b8cf1 Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Project-Name: admin Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Role: member,reader,admin Sep 16 07:58:40.891436 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Roles: member,reader,admin Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1dfa255cacf3473b9f6619fec53b8cf1", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Tenant: admin Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Tenant-Id: 1dfa255cacf3473b9f6619fec53b8cf1 Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Tenant-Name: admin Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User: admin Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User-Domain-Id: default Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User-Domain-Name: Default Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User-Id: 4763f3bdfee74904a41057be46f076ed Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User-Name: admin Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: method: > Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: exception: Flavor 84 could not be found. Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: action_args: {'id': '84'} Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 07:58:40.892954 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 07:58:40.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:40.895151 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-0f5c8404-ef76-4eb0-a042-63a630521bd4 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 07:58:40.896167 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-0f5c8404-ef76-4eb0-a042-63a630521bd4 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.391763 Sep 16 07:58:40.896167 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 23/44] 10.222.0.59 () {60 vars in 1190 bytes} [Fri Sep 16 07:58:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 393 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 07:58:40.903281 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-21ee6c35-a4b2-433d-a7dd-8097a279cd8b admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:40.917979 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-21ee6c35-a4b2-433d-a7dd-8097a279cd8b admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018382 Sep 16 07:58:40.918507 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 22/45] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Sep 16 07:58:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 07:58:40.927783 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-e0ae3496-3879-4bcb-af16-25e3dd84ca17 admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:40.943222 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-e0ae3496-3879-4bcb-af16-25e3dd84ca17 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018935 Sep 16 07:58:40.943729 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 24/46] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Sep 16 07:58:40 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 20 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 07:58:40.953101 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-467d2ecd-cfa8-479f-930b-879cce2ba401 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:40.957829 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.wsgi [None req-467d2ecd-cfa8-479f-930b-879cce2ba401 admin admin] HTTP exception thrown: Flavor 84 could not be found. Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-467d2ecd-cfa8-479f-930b-879cce2ba401 admin admin] Request method failure captured: Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: request: GET /compute/v2.1/flavors/84 HTTP/1.1 Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Accept: application/json Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Accept-Encoding: gzip, deflate Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Connection: keep-alive Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Content-Length: 0 Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Host: 10.222.0.59 Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Openstack-Api-Version: compute 2.92 Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Openstack-System-Scope: None Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: User-Agent: python-novaclient Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Auth-Token: gAAAAABjJCywelqHqEFJOXWg_qiXjOu8LwEze7Oigaam15IMuHPE3mQ6G5YMi4pMr4IZJ0lMIQiIp_gUM1f-x2GODtqRaJbfRcSXnJ4ZRwWSRD-TaGd3U_-2Dk5la76UwBasTadfWYRrzIAK4Yi8xhtgMf10JL3Wd0ogE_IUb5_KCagGDZY1S0c Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Domain-Id: None Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Domain-Name: None Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Identity-Status: Confirmed Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Is-Admin-Project: True Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Project-Domain-Id: default Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Project-Domain-Name: Default Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Project-Id: 1dfa255cacf3473b9f6619fec53b8cf1 Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Project-Name: admin Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Role: member,reader,admin Sep 16 07:58:40.959346 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Roles: member,reader,admin Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1dfa255cacf3473b9f6619fec53b8cf1", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Tenant: admin Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Tenant-Id: 1dfa255cacf3473b9f6619fec53b8cf1 Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Tenant-Name: admin Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User: admin Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User-Domain-Id: default Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User-Domain-Name: Default Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User-Id: 4763f3bdfee74904a41057be46f076ed Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User-Name: admin Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: method: > Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: exception: Flavor 84 could not be found. Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: action_args: {'id': '84'} Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 07:58:40.960849 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 84 could not be found. Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 07:58:40.962405 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 84 could not be found. Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 84 could not be found. Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:40.963819 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-467d2ecd-cfa8-479f-930b-879cce2ba401 admin admin] Returning 404 to user: Flavor 84 could not be found. {{(pid=106022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 07:58:40.965066 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-467d2ecd-cfa8-479f-930b-879cce2ba401 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84" status: 404 len: 75 microversion: 2.92 time: 0.011067 Sep 16 07:58:40.965066 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 23/47] 10.222.0.59 () {60 vars in 1190 bytes} [Fri Sep 16 07:58:40 2022] GET /compute/v2.1/flavors/84 => generated 75 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (1 switches on core 0) Sep 16 07:58:42.167243 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-e0ae3496-3879-4bcb-af16-25e3dd84ca17 admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:42.168290 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-e0ae3496-3879-4bcb-af16-25e3dd84ca17 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001496 Sep 16 07:58:42.168687 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 25/48] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Sep 16 07:58:42 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:42.686337 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-45115f5a-2f94-4ef7-af00-3ace268d37f5 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:42.692239 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.wsgi [None req-45115f5a-2f94-4ef7-af00-3ace268d37f5 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-45115f5a-2f94-4ef7-af00-3ace268d37f5 admin admin] Request method failure captured: Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Accept: application/json Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Accept-Encoding: gzip, deflate Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Connection: keep-alive Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Content-Length: 0 Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Host: 10.222.0.59 Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Openstack-Api-Version: compute 2.92 Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Openstack-System-Scope: None Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: User-Agent: python-novaclient Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Auth-Token: gAAAAABjJCyyn5m3lMHMaRWEbE1ON79ff1aqVeU6GioOJAptr4eJiv-ELd1_S5WPnAHud9i4d4vqaIdanjQf26l-omim0V9u-0uR88tM6BOEsfqpxrcQwHMq1o7aH4d5MjFf7539q9xx-5X0hUqJAWw5e31FnbVuQefLHXFR4MlOxJSPLWOKcRQ Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Domain-Id: None Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Domain-Name: None Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Identity-Status: Confirmed Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Is-Admin-Project: True Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Project-Domain-Id: default Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Project-Domain-Name: Default Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Project-Id: 1dfa255cacf3473b9f6619fec53b8cf1 Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Project-Name: admin Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Role: member,reader,admin Sep 16 07:58:42.693736 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Roles: member,reader,admin Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1dfa255cacf3473b9f6619fec53b8cf1", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Tenant: admin Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Tenant-Id: 1dfa255cacf3473b9f6619fec53b8cf1 Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-Tenant-Name: admin Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User: admin Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User-Domain-Id: default Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User-Domain-Name: Default Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User-Id: 4763f3bdfee74904a41057be46f076ed Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: X-User-Name: admin Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: method: > Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: exception: Flavor 451 could not be found. Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: action_args: {'id': '451'} Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 07:58:42.695474 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 07:58:42.697499 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: ERROR nova.api.openstack.wsgi Sep 16 07:58:42.698810 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-45115f5a-2f94-4ef7-af00-3ace268d37f5 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106022) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 07:58:42.700035 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-45115f5a-2f94-4ef7-af00-3ace268d37f5 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.390835 Sep 16 07:58:42.700035 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 24/49] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Sep 16 07:58:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 392 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 16 07:58:42.704977 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-099322e7-7120-465e-a367-e904f3ff542e admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:42.719661 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-099322e7-7120-465e-a367-e904f3ff542e admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.018264 Sep 16 07:58:42.720178 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 26/50] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Sep 16 07:58:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 19 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 07:58:42.730073 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:42.745560 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors?is_public=None" status: 200 len: 2056 microversion: 2.92 time: 0.019455 Sep 16 07:58:42.746102 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 25/51] 10.222.0.59 () {60 vars in 1210 bytes} [Fri Sep 16 07:58:42 2022] GET /compute/v2.1/flavors?is_public=None => generated 2056 bytes in 21 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 07:58:42.755445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-534d6abc-8781-4c80-a2ea-0836a43a60d9 admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:42.760411 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.wsgi [None req-534d6abc-8781-4c80-a2ea-0836a43a60d9 admin admin] HTTP exception thrown: Flavor 451 could not be found. Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-534d6abc-8781-4c80-a2ea-0836a43a60d9 admin admin] Request method failure captured: Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: request: GET /compute/v2.1/flavors/451 HTTP/1.1 Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Accept: application/json Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Accept-Encoding: gzip, deflate Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Connection: keep-alive Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Content-Length: 0 Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Host: 10.222.0.59 Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Openstack-Api-Version: compute 2.92 Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Openstack-System-Scope: None Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: User-Agent: python-novaclient Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Auth-Token: gAAAAABjJCyyn5m3lMHMaRWEbE1ON79ff1aqVeU6GioOJAptr4eJiv-ELd1_S5WPnAHud9i4d4vqaIdanjQf26l-omim0V9u-0uR88tM6BOEsfqpxrcQwHMq1o7aH4d5MjFf7539q9xx-5X0hUqJAWw5e31FnbVuQefLHXFR4MlOxJSPLWOKcRQ Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Domain-Id: None Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Domain-Name: None Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Identity-Status: Confirmed Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Is-Admin-Project: True Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Openstack-Nova-Api-Version: 2.92 Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Project-Domain-Id: default Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Project-Domain-Name: Default Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Project-Id: 1dfa255cacf3473b9f6619fec53b8cf1 Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Project-Name: admin Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Role: member,reader,admin Sep 16 07:58:42.761931 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Roles: member,reader,admin Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_1dfa255cacf3473b9f6619fec53b8cf1", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/1dfa255cacf3473b9f6619fec53b8cf1"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Tenant: admin Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Tenant-Id: 1dfa255cacf3473b9f6619fec53b8cf1 Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-Tenant-Name: admin Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User: admin Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User-Domain-Id: default Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User-Domain-Name: Default Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User-Id: 4763f3bdfee74904a41057be46f076ed Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: X-User-Name: admin Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: method: > Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: exception: Flavor 451 could not be found. Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: action_args: {'id': '451'} Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 07:58:42.763497 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 66, in show Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi flavor = flavors.get_flavor_by_flavor_id(id, ctxt=context) Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/flavors.py", line 139, in get_flavor_by_flavor_id Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi return objects.Flavor.get_by_flavor_id(ctxt, flavorid, read_deleted) Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 390, in get_by_flavor_id Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi db_flavor = cls._flavor_get_by_flavor_id_from_db(context, Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/db/utils.py", line 35, in wrapper Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/flavor.py", line 317, in _flavor_get_by_flavor_id_from_db Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi raise exception.FlavorNotFound(flavor_id=flavor_id) Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi nova.exception.FlavorNotFound: Flavor 451 could not be found. Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 07:58:42.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/flavors.py", line 68, in show Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPNotFound(explanation=e.format_message()) Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Flavor 451 could not be found. Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Flavor 451 could not be found. Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: ERROR nova.api.openstack.wsgi Sep 16 07:58:42.765445 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-534d6abc-8781-4c80-a2ea-0836a43a60d9 admin admin] Returning 404 to user: Flavor 451 could not be found. {{(pid=106023) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 07:58:42.766486 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-534d6abc-8781-4c80-a2ea-0836a43a60d9 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451" status: 404 len: 76 microversion: 2.92 time: 0.011433 Sep 16 07:58:42.766486 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 27/52] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Sep 16 07:58:42 2022] GET /compute/v2.1/flavors/451 => generated 76 bytes in 12 msecs (HTTP/1.1 404) 9 headers in 380 bytes (2 switches on core 0) Sep 16 07:58:43.967532 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:43.968540 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001465 Sep 16 07:58:43.968936 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 26/53] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Sep 16 07:58:43 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:44.481065 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-832e282e-61c8-48d1-a81e-120a7463e53c admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.nano", "ram": 256, "vcpus": 1, "disk": 1, "id": "42", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:44.561663 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-832e282e-61c8-48d1-a81e-120a7463e53c admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 404 microversion: 2.92 time: 0.458414 Sep 16 07:58:44.562204 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 28/54] 10.222.0.59 () {64 vars in 1235 bytes} [Fri Sep 16 07:58:44 2022] POST /compute/v2.1/flavors => generated 404 bytes in 460 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 07:58:45.766401 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:45.767440 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001458 Sep 16 07:58:45.767854 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 27/55] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Sep 16 07:58:45 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:46.287894 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-8865c869-a14a-4577-98a2-4bf7ad88a1f9 admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.micro", "ram": 256, "vcpus": 1, "disk": 2, "id": "84", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:46.367407 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-8865c869-a14a-4577-98a2-4bf7ad88a1f9 admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 405 microversion: 2.92 time: 0.460906 Sep 16 07:58:46.367946 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 29/56] 10.222.0.59 () {64 vars in 1235 bytes} [Fri Sep 16 07:58:45 2022] POST /compute/v2.1/flavors => generated 405 bytes in 462 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 07:58:47.581180 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:47.582187 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001416 Sep 16 07:58:47.582581 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 28/57] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Sep 16 07:58:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:48.101112 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-65b31d76-9f2b-4f71-929f-ae8b26aa86be admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat", "ram": 512, "vcpus": 1, "disk": 1, "id": "451", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:48.161990 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-65b31d76-9f2b-4f71-929f-ae8b26aa86be admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 407 microversion: 2.92 time: 0.442328 Sep 16 07:58:48.162462 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 30/58] 10.222.0.59 () {64 vars in 1235 bytes} [Fri Sep 16 07:58:47 2022] POST /compute/v2.1/flavors => generated 407 bytes in 444 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 07:58:49.362536 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:49.363689 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001576 Sep 16 07:58:49.364080 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 29/59] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Sep 16 07:58:49 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:49.995891 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-d884e511-5ca9-4157-9b50-443b9851125a admin admin] Action: 'create', calling method: >, body: {"flavor": {"name": "m1.heat2", "ram": 1024, "vcpus": 1, "disk": 1, "id": "452", "swap": 0, "OS-FLV-EXT-DATA:ephemeral": 0, "rxtx_factor": 1.0, "os-flavor-access:is_public": true}} {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 07:58:50.093523 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-d884e511-5ca9-4157-9b50-443b9851125a admin admin] 10.222.0.59 "POST /compute/v2.1/flavors" status: 200 len: 409 microversion: 2.92 time: 0.594642 Sep 16 07:58:50.094001 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 31/60] 10.222.0.59 () {64 vars in 1235 bytes} [Fri Sep 16 07:58:49 2022] POST /compute/v2.1/flavors => generated 409 bytes in 596 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 07:58:51.305680 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:51.306708 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 16 07:58:51.307106 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 30/61] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Sep 16 07:58:51 2022] GET /compute/v2.1 => generated 388 bytes in 3 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:58:51.823796 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-4662425e-dc5d-437d-a1a8-201691b9bb9c admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:58:51.844350 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-4662425e-dc5d-437d-a1a8-201691b9bb9c admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail" status: 200 len: 5777 microversion: 2.92 time: 0.400516 Sep 16 07:58:51.844894 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 32/62] 10.222.0.59 () {60 vars in 1202 bytes} [Fri Sep 16 07:58:51 2022] GET /compute/v2.1/flavors/detail => generated 5777 bytes in 402 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 07:59:47.976417 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:59:47.977419 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-25ec5178-57d0-4909-99a3-fb802cfc9e57 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001469 Sep 16 07:59:47.977816 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 31/63] 10.222.0.59 () {54 vars in 931 bytes} [Fri Sep 16 07:59:47 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 07:59:47.988225 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writing DB stats nova_api:INSERT=5,nova_api:SELECT=28 {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:59:48.366535 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-d30347b4-e423-4a32-8a21-4112e3fc7dd7 admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:59:48.386877 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-d30347b4-e423-4a32-8a21-4112e3fc7dd7 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/detail?is_public=True" status: 200 len: 5791 microversion: 2.61 time: 0.403134 Sep 16 07:59:48.387417 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 33/64] 10.222.0.59 () {60 vars in 1292 bytes} [Fri Sep 16 07:59:47 2022] GET /compute/v2.1/flavors/detail?is_public=True => generated 5791 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 07:59:48.408094 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG dbcounter [-] [106022] Writing DB stats nova_api:SELECT=14 {{(pid=106022) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 07:59:48.412410 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-ba9d5cae-ded3-4a5f-b74d-4a2b31178681 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:59:48.419530 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-ba9d5cae-ded3-4a5f-b74d-4a2b31178681 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/42/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.012826 Sep 16 07:59:48.420036 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 32/65] 10.222.0.59 () {60 vars in 1283 bytes} [Fri Sep 16 07:59:48 2022] GET /compute/v2.1/flavors/42/os-extra_specs => generated 19 bytes in 14 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 07:59:48.432252 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-486a4284-5db8-4205-8ed7-d5d4446c34ca admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:59:48.439531 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-486a4284-5db8-4205-8ed7-d5d4446c34ca admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/451/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010858 Sep 16 07:59:48.440043 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 34/66] 10.222.0.59 () {60 vars in 1286 bytes} [Fri Sep 16 07:59:48 2022] GET /compute/v2.1/flavors/451/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 07:59:48.451184 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-a9f9c28d-1afe-4679-ba33-38ef67444227 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:59:48.458094 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-a9f9c28d-1afe-4679-ba33-38ef67444227 admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/452/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010483 Sep 16 07:59:48.458598 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 33/67] 10.222.0.59 () {60 vars in 1286 bytes} [Fri Sep 16 07:59:48 2022] GET /compute/v2.1/flavors/452/os-extra_specs => generated 19 bytes in 11 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 07:59:48.469838 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-c8605687-3e3d-4772-a722-d69ff1d170cb admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 07:59:48.477339 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-c8605687-3e3d-4772-a722-d69ff1d170cb admin admin] 10.222.0.59 "GET /compute/v2.1/flavors/84/os-extra_specs" status: 200 len: 19 microversion: 2.61 time: 0.010960 Sep 16 07:59:48.477845 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 35/68] 10.222.0.59 () {60 vars in 1283 bytes} [Fri Sep 16 07:59:48 2022] GET /compute/v2.1/flavors/84/os-extra_specs => generated 19 bytes in 12 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:03:14.779680 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-a9f9c28d-1afe-4679-ba33-38ef67444227 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:03:14.780704 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-a9f9c28d-1afe-4679-ba33-38ef67444227 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001477 Sep 16 08:03:14.781103 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 34/69] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Sep 16 08:03:14 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:03:14.919712 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writing DB stats nova_api:SELECT=6 {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:03:15.060252 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-971aa0a2-9e60-470d-9971-a755fc9e7733 admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:03:15.064940 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-971aa0a2-9e60-470d-9971-a755fc9e7733 admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:03:15.065413 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-971aa0a2-9e60-470d-9971-a755fc9e7733 admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:03:15.066432 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-971aa0a2-9e60-470d-9971-a755fc9e7733 admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:03:15.067180 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-971aa0a2-9e60-470d-9971-a755fc9e7733 admin admin] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:03:15.067627 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-971aa0a2-9e60-470d-9971-a755fc9e7733 admin admin] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:03:15.068045 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-971aa0a2-9e60-470d-9971-a755fc9e7733 admin admin] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:03:15.098913 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-971aa0a2-9e60-470d-9971-a755fc9e7733 admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.180343 Sep 16 08:03:15.099444 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 36/70] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Sep 16 08:03:14 2022] GET /compute/v2.1/os-services => generated 794 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 08:03:16.175402 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-a9f9c28d-1afe-4679-ba33-38ef67444227 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:03:16.176438 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-a9f9c28d-1afe-4679-ba33-38ef67444227 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001452 Sep 16 08:03:16.176832 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 35/71] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Sep 16 08:03:16 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:03:16.368595 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-48a60e63-b601-4a89-9253-9d4729df6bec admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:03:16.371996 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-48a60e63-b601-4a89-9253-9d4729df6bec admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:03:16.372479 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-48a60e63-b601-4a89-9253-9d4729df6bec admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:03:16.372921 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-48a60e63-b601-4a89-9253-9d4729df6bec admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:03:16.373641 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-48a60e63-b601-4a89-9253-9d4729df6bec admin admin] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:03:16.374124 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-48a60e63-b601-4a89-9253-9d4729df6bec admin admin] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:03:16.374544 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-48a60e63-b601-4a89-9253-9d4729df6bec admin admin] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:03:16.395031 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-48a60e63-b601-4a89-9253-9d4729df6bec admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 794 microversion: 2.92 time: 0.076632 Sep 16 08:03:16.395523 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 37/72] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Sep 16 08:03:16 2022] GET /compute/v2.1/os-services => generated 794 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 08:03:27.903989 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-a9f9c28d-1afe-4679-ba33-38ef67444227 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:03:27.905001 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-a9f9c28d-1afe-4679-ba33-38ef67444227 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001417 Sep 16 08:03:27.905398 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 36/73] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Sep 16 08:03:27 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:03:28.049887 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writing DB stats nova_cell0:SELECT=4 {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:03:28.050537 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writing DB stats nova_cell1:SELECT=4 {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:03:28.051202 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG dbcounter [-] [106023] Writing DB stats nova_api:SELECT=8 {{(pid=106023) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:03:28.099616 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-366ea118-58be-49dd-a9f3-9b7f6923a76a admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:03:28.103042 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-366ea118-58be-49dd-a9f3-9b7f6923a76a admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:03:28.103512 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-366ea118-58be-49dd-a9f3-9b7f6923a76a admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:03:28.103934 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-366ea118-58be-49dd-a9f3-9b7f6923a76a admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:03:28.104639 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-366ea118-58be-49dd-a9f3-9b7f6923a76a admin admin] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:03:28.105074 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-366ea118-58be-49dd-a9f3-9b7f6923a76a admin admin] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:03:28.105489 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-366ea118-58be-49dd-a9f3-9b7f6923a76a admin admin] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:03:28.130699 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-366ea118-58be-49dd-a9f3-9b7f6923a76a admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.084812 Sep 16 08:03:28.131261 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 38/74] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Sep 16 08:03:28 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:03:29.196517 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: DEBUG nova.api.openstack.wsgi [None req-a9f9c28d-1afe-4679-ba33-38ef67444227 admin admin] Calling method '>' {{(pid=106022) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:03:29.197525 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: INFO nova.api.openstack.requestlog [None req-a9f9c28d-1afe-4679-ba33-38ef67444227 admin admin] 10.222.0.59 "GET /compute/v2.1" status: 200 len: 388 microversion: 2.1 time: 0.001420 Sep 16 08:03:29.197924 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: [pid: 106022|app: 0|req: 37/75] 10.222.0.59 () {56 vars in 1074 bytes} [Fri Sep 16 08:03:29 2022] GET /compute/v2.1 => generated 388 bytes in 2 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:03:29.390717 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG nova.api.openstack.wsgi [None req-06519e56-a27d-421a-a39b-c114ef00605d admin admin] Calling method '>' {{(pid=106023) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:03:29.394046 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-06519e56-a27d-421a-a39b-c114ef00605d admin admin] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:03:29.394521 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-06519e56-a27d-421a-a39b-c114ef00605d admin admin] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:03:29.395011 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-06519e56-a27d-421a-a39b-c114ef00605d admin admin] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:03:29.396211 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-06519e56-a27d-421a-a39b-c114ef00605d admin admin] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:03:29.396659 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-06519e56-a27d-421a-a39b-c114ef00605d admin admin] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:03:29.397072 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: DEBUG oslo_concurrency.lockutils [None req-06519e56-a27d-421a-a39b-c114ef00605d admin admin] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=106023) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:03:29.421007 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: INFO nova.api.openstack.requestlog [None req-06519e56-a27d-421a-a39b-c114ef00605d admin admin] 10.222.0.59 "GET /compute/v2.1/os-services" status: 200 len: 1014 microversion: 2.92 time: 0.078816 Sep 16 08:03:29.421007 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: [pid: 106023|app: 0|req: 39/76] 10.222.0.59 () {60 vars in 1193 bytes} [Fri Sep 16 08:03:29 2022] GET /compute/v2.1/os-services => generated 1014 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:04:25.736075 dv-cinder-740146-20-iscsi systemd[1]: Stopping Devstack devstack@n-api.service... Sep 16 08:04:25.736598 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: Fri Sep 16 08:04:25 2022 - graceful shutdown triggered... Sep 16 08:04:25.737030 dv-cinder-740146-20-iscsi devstack@n-api.service[106022]: Gracefully killing worker 1 (pid: 106022)... Sep 16 08:04:25.737387 dv-cinder-740146-20-iscsi devstack@n-api.service[106023]: Gracefully killing worker 2 (pid: 106023)... Sep 16 08:04:26.737515 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: worker 1 buried after 1 seconds Sep 16 08:04:26.738055 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: worker 2 buried after 1 seconds Sep 16 08:04:26.738055 dv-cinder-740146-20-iscsi devstack@n-api.service[106021]: goodbye to uWSGI. Sep 16 08:04:26.739221 dv-cinder-740146-20-iscsi systemd[1]: devstack@n-api.service: Succeeded. Sep 16 08:04:26.739769 dv-cinder-740146-20-iscsi systemd[1]: Stopped Devstack devstack@n-api.service. Sep 16 08:04:26.743113 dv-cinder-740146-20-iscsi systemd[1]: Starting Devstack devstack@n-api.service... Sep 16 08:04:26.753366 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: [uWSGI] getting INI configuration from /etc/nova/nova-api-uwsgi.ini Sep 16 08:04:26.755982 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: *** Starting uWSGI 2.0.18-debian (64bit) on [Fri Sep 16 08:04:26 2022] *** Sep 16 08:04:26.756150 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: compiled with version: 10.0.1 20200405 (experimental) [master revision 0be9efad938:fcb98e4978a:705510a708d3642c9c962beb663c476167e4e8a4] on 11 April 2020 11:15:55 Sep 16 08:04:26.756285 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: os: Linux-5.4.0-72-generic #80-Ubuntu SMP Mon Apr 12 17:35:00 UTC 2021 Sep 16 08:04:26.756398 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: nodename: dv-cinder-740146-20-iscsi Sep 16 08:04:26.756507 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: machine: x86_64 Sep 16 08:04:26.756616 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: clock source: unix Sep 16 08:04:26.756724 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: pcre jit disabled Sep 16 08:04:26.756843 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: detected number of CPU cores: 4 Sep 16 08:04:26.756951 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: current working directory: / Sep 16 08:04:26.757059 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: detected binary path: /usr/bin/uwsgi-core Sep 16 08:04:26.757757 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: your processes number limit is 47680 Sep 16 08:04:26.757894 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: your memory page size is 4096 bytes Sep 16 08:04:26.758007 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: detected max file descriptor number: 2048 Sep 16 08:04:26.758238 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: lock engine: pthread robust mutexes Sep 16 08:04:26.758551 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: thunder lock: enabled Sep 16 08:04:26.758886 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: uwsgi socket 0 bound to UNIX address /var/run/uwsgi/nova-api-wsgi.socket fd 4 Sep 16 08:04:26.759087 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: Python version: 3.8.10 (default, Jun 22 2022, 20:18:18) [GCC 9.4.0] Sep 16 08:04:26.798425 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: Python main interpreter initialized at 0x561484ea89c0 Sep 16 08:04:26.798722 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: python threads support enabled Sep 16 08:04:26.798868 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: your server socket listen backlog is limited to 100 connections Sep 16 08:04:26.798986 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: your mercy for graceful operations on workers is 90 seconds Sep 16 08:04:26.799418 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: mapped 403077 bytes (393 KB) for 2 cores Sep 16 08:04:26.799644 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: *** Operational MODE: preforking *** Sep 16 08:04:26.800063 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: *** uWSGI is running in multiple interpreter mode *** Sep 16 08:04:26.800196 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: spawned uWSGI master process (pid: 121030) Sep 16 08:04:26.800513 dv-cinder-740146-20-iscsi systemd[1]: Started Devstack devstack@n-api.service. Sep 16 08:04:26.801654 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: spawned uWSGI worker 1 (pid: 121046, cores: 1) Sep 16 08:04:26.801654 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: spawned uWSGI worker 2 (pid: 121047, cores: 1) Sep 16 08:04:26.801654 dv-cinder-740146-20-iscsi devstack@n-api.service[121030]: running "unix_signal:15 gracefully_kill_them_all" (master-start)... Sep 16 08:04:27.467675 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 08:04:27.471357 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Modules with known eventlet monkey patching issues were imported prior to eventlet monkey patching: urllib3. This warning can usually be ignored if the caller is only importing and not executing nova code. Sep 16 08:04:28.631483 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 08:04:28.631483 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: from cryptography.utils import int_from_bytes Sep 16 08:04:28.632164 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 08:04:28.632164 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: from cryptography.utils import int_from_bytes Sep 16 08:04:28.641025 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: /usr/lib/python3/dist-packages/secretstorage/dhcrypto.py:15: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 08:04:28.641025 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: from cryptography.utils import int_from_bytes Sep 16 08:04:28.641553 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: /usr/lib/python3/dist-packages/secretstorage/util.py:19: CryptographyDeprecationWarning: int_from_bytes is deprecated, use int.from_bytes instead Sep 16 08:04:28.641553 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: from cryptography.utils import int_from_bytes Sep 16 08:04:31.053502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 08:04:31.054610 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 08:04:31.054938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 08:04:31.055192 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 08:04:31.055452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 08:04:31.055852 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.056192 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.056518 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.056845 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.057176 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.057488 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.057813 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.058127 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.058459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.058749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.059071 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.059572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-20-iscsi {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.059900 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.060217 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.060533 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.060858 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.061166 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.061491 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.061799 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.062310 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.063762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.063762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.063762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.064049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.064357 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.064670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.064990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.065325 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.065631 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.065956 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.066360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-20-iscsi {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.066722 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.067028 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.067344 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.067757 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.068072 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.068397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.068724 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.069035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.069379 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.069762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.070159 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.070635 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.071153 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.071615 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.072122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.072449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.072776 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.073086 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.073395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.073648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.073960 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.074284 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.074605 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.074952 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.075209 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.075464 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.075785 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.076104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.076419 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.076735 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.077063 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.077348 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.077655 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.077974 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.078745 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.078745 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.078938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.079206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.079532 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.079839 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.080160 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.080572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.080816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.081033 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2589}} Sep 16 08:04:31.081470 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.081559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] Configuration options gathered from: {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2590}} Sep 16 08:04:31.081633 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.081813 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.081926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] command line args: [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2591}} Sep 16 08:04:31.082082 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.082237 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] config files: ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2592}} Sep 16 08:04:31.082384 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.082537 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ================================================================================ {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2594}} Sep 16 08:04:31.082768 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.082936 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] allow_resize_to_same_host = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.083090 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.083236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] arq_binding_timeout = 300 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.083380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.083539 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries = 60 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.083704 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.083859 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] block_device_allocate_retries_interval = 3 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.084007 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.084159 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cert = self.pem {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.084354 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.084516 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute_driver = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.084679 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.084826 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute_monitors = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.084970 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.085126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] config_dir = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.085271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] config_drive_format = iso9660 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.085592 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.085765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] config_file = ['/etc/nova/api-paste.ini', '/etc/nova/nova.conf'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.085923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.086078 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] config_source = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.086223 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.086376 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.086533 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] console_host = dv-cinder-740146-20-iscsi {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.086713 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.086865 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] control_exchange = nova {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.087020 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.087217 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cpu_allocation_ratio = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.087383 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.087542 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] daemon = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.087698 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.087843 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] debug = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.087997 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.088171 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] default_access_ip_network_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.088326 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.088473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] default_availability_zone = nova {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.088618 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.088776 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] default_ephemeral_format = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.088928 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.088928 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.089596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] default_log_levels = ['amqp=WARN', 'amqplib=WARN', 'boto=WARN', 'qpid=WARN', 'sqlalchemy=WARN', 'suds=INFO', 'oslo.messaging=INFO', 'oslo_messaging=INFO', 'iso8601=WARN', 'requests.packages.urllib3.connectionpool=WARN', 'urllib3.connectionpool=WARN', 'websocket=WARN', 'requests.packages.urllib3.util.retry=WARN', 'urllib3.util.retry=WARN', 'keystonemiddleware=WARN', 'routes.middleware=WARN', 'stevedore=WARN', 'taskflow=WARN', 'keystoneauth=WARN', 'oslo.cache=INFO', 'oslo_policy=INFO', 'dogpile.core.dogpile=INFO', 'glanceclient=WARN', 'oslo.privsep.daemon=INFO'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.089791 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.089969 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] default_schedule_zone = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.090116 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.090261 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] disk_allocation_ratio = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.090419 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.090586 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] enable_new_services = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.090884 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.091059 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] enabled_apis = ['osapi_compute'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.091207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.091351 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] enabled_ssl_apis = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.091510 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.091664 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] flat_injected = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.091820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.091983 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] force_config_drive = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.092139 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.092292 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] force_raw_images = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.092436 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.092588 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] graceful_shutdown_timeout = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.092742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.092900 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] heal_instance_info_cache_interval = 60 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.093045 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.093197 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] host = dv-cinder-740146-20-iscsi {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.093342 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.093487 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] initial_cpu_allocation_ratio = 16.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.093642 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.093789 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] initial_disk_allocation_ratio = 1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.093950 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.094096 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] initial_ram_allocation_ratio = 1.5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.094239 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.094239 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.094530 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] injected_network_template = /opt/stack/nova/nova/virt/interfaces.template {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.094701 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.094855 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] instance_build_timeout = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.095010 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.095166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] instance_delete_interval = 300 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.095325 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.095471 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] instance_format = [instance: %(uuid)s] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.095623 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.095786 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] instance_name_template = instance-%08x {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.095943 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.096098 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.096257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.096410 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] instance_usage_audit_period = month {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.096563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.096714 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] instance_uuid_format = [instance: %(uuid)s] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.096860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.097012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] instances_path = /opt/stack/data/nova/instances {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.097167 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.097367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] internal_service_availability_zone = internal {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.097519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.097670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] key = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.097825 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.097984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] live_migration_retry_count = 30 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.098137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.098290 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] log_config_append = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.098442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.098587 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] log_date_format = %Y-%m-%d %H:%M:%S {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.098811 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.098975 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] log_dir = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.099131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.099302 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] log_file = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.099862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.100019 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] log_options = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.100174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.100341 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.100488 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.101137 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] log_rotate_interval_type = days {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.101419 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.101571 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] log_rotation_type = none {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.101715 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.101870 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] logging_context_format_string = %(color)s%(levelname)s %(name)s [%(global_request_id)s %(request_id)s %(project_name)s %(user_name)s%(color)s] %(instance)s%(color)s%(message)s {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.102019 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.102173 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] logging_debug_format_suffix = {{(pid=%(process)d) %(funcName)s %(pathname)s:%(lineno)d}} {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.102173 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] logging_default_format_string = %(color)s%(levelname)s %(name)s [-%(color)s] %(instance)s%(color)s%(message)s {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.102448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.102615 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] logging_exception_prefix = ERROR %(name)s %(instance)s {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.102788 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.102946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] logging_user_identity_format = %(user)s %(project)s %(domain)s %(system_scope)s %(user_domain)s %(project_domain)s {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.103094 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.103239 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] long_rpc_timeout = 1800 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.103392 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.103546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_builds = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.103691 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.103835 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_live_migrations = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.103987 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.104139 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] max_concurrent_snapshots = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.104300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.104452 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] max_local_block_devices = 3 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.104606 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.104758 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_count = 30 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.104910 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.105062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] max_logfile_size_mb = 200 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.105219 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.105375 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] maximum_instance_delete_attempts = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.105527 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.105679 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen = 0.0.0.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.105824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.105975 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] metadata_listen_port = 8775 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.106128 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.106311 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] metadata_workers = 2 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.106479 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.106635 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] migrate_max_retries = -1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.106848 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.107005 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] mkisofs_cmd = genisoimage {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.107158 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.107351 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] my_block_storage_ip = 10.222.0.59 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.107514 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.107667 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] my_ip = 10.222.0.59 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.107818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.107987 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] network_allocate_retries = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.108142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.108298 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] non_inheritable_image_properties = ['cache_in_nova', 'bittorrent'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.108444 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.108606 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen = 0.0.0.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.108757 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.108922 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_listen_port = 8774 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.109067 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.109219 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_unique_server_name_scope = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.109371 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.109535 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] osapi_compute_workers = 2 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.110068 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.110298 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] password_length = 12 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.110453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.110600 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] periodic_enable = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.110777 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.110927 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] periodic_fuzzy_delay = 60 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.111092 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.111245 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] pointer_model = usbtablet {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.111536 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.111697 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] preallocate_images = none {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.111850 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.111996 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] publish_errors = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.112155 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.112309 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] pybasedir = /opt/stack/nova {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.112454 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.112600 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ram_allocation_ratio = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.112752 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.112896 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_burst = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.113060 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.113215 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_except_level = CRITICAL {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.113366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.113517 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] rate_limit_interval = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.113663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.113807 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] reboot_timeout = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.113960 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.114105 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] reclaim_instance_interval = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.114257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.114400 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] record = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.114551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.114740 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] reimage_timeout_per_gb = 20 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.114893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.115049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] report_interval = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.115205 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.115357 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] rescue_timeout = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.115502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.115656 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_cpus = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.115810 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.115955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_disk_mb = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.116099 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.116242 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_host_memory_mb = 512 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.117048 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.117210 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] reserved_huge_pages = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.117398 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.117550 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] resize_confirm_window = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.117550 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] resize_fs_using_block_device = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.117836 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.117980 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] resume_guests_state_on_host_boot = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.118138 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.118283 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] rootwrap_config = /etc/nova/rootwrap.conf {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.118427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.118578 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_action = reap {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.118742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.118912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_poll_interval = 1800 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.119074 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.119221 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] running_deleted_instance_timeout = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.119366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.119523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler_instance_sync_interval = 120 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.119679 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.120229 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] service_down_time = 60 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.120395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.120395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.120698 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] servicegroup_driver = db {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.120858 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.121023 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] shelved_offload_time = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.121169 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.121314 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] shelved_poll_interval = 3600 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.121485 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.121784 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] shutdown_timeout = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.121938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.122140 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] source_is_ipv6 = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.122303 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.122457 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ssl_only = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.122611 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.122797 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] state_path = /opt/stack/data/nova {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.122956 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.123105 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_interval = 600 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.123257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.123450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] sync_power_state_pool_size = 1000 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.123613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.123766 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] syslog_log_facility = LOG_USER {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.124581 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.124744 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] tempdir = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.124901 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.125067 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] timeout_nbd = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.125216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.125361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] transport_url = **** {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.125520 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.125673 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] update_resources_interval = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.125825 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.125971 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] use_cow_images = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.126114 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.126260 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] use_eventlog = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.126420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.126573 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] use_journal = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.126739 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.126913 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] use_json = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.127060 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.127214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] use_rootwrap_daemon = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.127368 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.127557 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] use_stderr = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.127718 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.127872 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] use_syslog = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.128017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.128171 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vcpu_pin_set = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.128319 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.128464 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_is_fatal = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.128616 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.128769 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vif_plugging_timeout = 300 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.128935 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.129096 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] virt_mkfs = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.129243 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.129389 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] volume_usage_poll_interval = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.129541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.129686 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] watch_log_file = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.129838 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.130232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] web = /usr/share/spice-html5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2602}} Sep 16 08:04:31.130564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.131325 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.disable_process_locking = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.131482 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.131809 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_concurrency.lock_path = /opt/stack/data/nova {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.132487 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.132648 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.auth_strategy = keystone {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.132803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.133189 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.compute_link_prefix = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.133355 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.133502 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.config_drive_skip_versions = 1.0 2007-01-19 2007-03-01 2007-08-29 2007-10-10 2007-12-15 2008-02-01 2008-09-01 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.133658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.133812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.dhcp_domain = novalocal {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.133966 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.134125 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.enable_instance_password = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.134272 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.134427 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.glance_link_prefix = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.134597 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.134945 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_fixed_size = 100 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.135131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.135282 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_cells_batch_strategy = distributed {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.135427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.135579 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.instance_list_per_project_cells = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.135734 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.135886 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.list_records_by_skipping_down_cells = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.136041 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.136194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.local_metadata_per_cell = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.136340 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.136492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.max_limit = 1000 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.136657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.136805 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.metadata_cache_expiration = 15 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.136963 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.137109 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.neutron_default_tenant_id = default {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.137261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.137413 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.use_forwarded_for = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.137618 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.137618 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.137924 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.use_neutron_default_nets = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.138070 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.138223 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_connect_timeout = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.138376 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.138521 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_failure_fatal = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.138712 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.138885 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_read_timeout = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.139036 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.139188 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_ssl_certfile = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.139341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.139494 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_dynamic_targets = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.139723 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.139881 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_jsonfile_path = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.140027 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.140434 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api.vendordata_providers = ['StaticJSON'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.140818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.140975 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend = dogpile.cache.memcached {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.141137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.141303 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.backend_argument = **** {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.141457 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.141602 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.config_prefix = cache.oslo {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.141754 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.142092 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.dead_timeout = 60.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.142245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.142390 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.debug_cache_backend = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.142555 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.142729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_retry_client = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.142892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.143048 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.enable_socket_keepalive = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.143203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.143356 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.enabled = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.143521 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.143677 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.expiration_time = 600 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.143830 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.143987 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_attempts = 2 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.144350 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.144503 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.hashclient_retry_delay = 1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.144657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.144811 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_dead_retry = 300 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.144956 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.145111 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_password = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.145265 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.145580 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_connection_get_timeout = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.145749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.145904 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_flush_on_reconnect = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.146050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.146257 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_maxsize = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.146351 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.146445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_pool_unused_timeout = 60 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.146538 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.146633 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_sasl_enabled = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.146781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.146872 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_servers = ['localhost:11211'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.146965 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.147051 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_socket_timeout = 1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.147136 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.147229 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.memcache_username = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.147326 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.147419 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.proxies = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.147671 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.147762 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_attempts = 2 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.148345 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.148443 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.retry_delay = 0.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.148544 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.148639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_count = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.148734 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.148829 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_idle = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.148923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.149020 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.socket_keepalive_interval = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.149120 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.149215 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_allowed_ciphers = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.149303 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.149395 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.149481 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.149572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.149666 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.149768 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_enabled = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.149855 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.149939 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cache.tls_keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.150031 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.150130 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_section = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.150503 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.150602 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.auth_type = password {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.150723 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.150812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.150897 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.151000 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.catalog_info = volumev3::publicURL {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.151092 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.151178 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.151263 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.151347 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.151439 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.151548 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.cross_az_attach = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.151643 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.151643 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.151807 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.debug = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.151892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.152002 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.endpoint_template = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.152269 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.152362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.http_retries = 3 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.152457 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.152543 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.152628 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.152722 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.152809 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.152894 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.os_region_name = RegionOne {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.152986 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.153072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.153156 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.153255 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cinder.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.153343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.153429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute.consecutive_build_service_disable_threshold = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.153524 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.153611 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_dedicated_set = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.153702 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.153801 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute.cpu_shared_set = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.153895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.153989 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute.image_type_exclude_list = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.154075 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.154167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute.live_migration_wait_for_vif_plug = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.154253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.154339 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_concurrent_disk_ops = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.154433 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.154528 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute.max_disk_devices_to_attach = -1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.154623 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.154748 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute.packing_host_numa_cells_allocation_strategy = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.154855 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.154943 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute.provider_config_location = /etc/nova/provider_config/ {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.155028 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.155100 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute.resource_provider_association_refresh = 300 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.155171 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.155252 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] compute.shutdown_retry_interval = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.155337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.155430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] conductor.workers = 2 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.155517 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.155609 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] console.allowed_origins = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.155700 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.155793 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_ciphers = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.155891 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.155986 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] console.ssl_minimum_version = default {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.156078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.156078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.156242 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] consoleauth.token_ttl = 600 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.156327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.156424 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.156517 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.156602 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.156693 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.156778 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.156875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.156961 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.157045 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.157129 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.connect_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.157214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.157305 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.endpoint_override = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.157398 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.157492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.157583 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.157676 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.157769 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.157843 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.max_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.157939 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.158025 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.min_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.158108 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.158201 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.region_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.158293 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.158385 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.158600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.158723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.service_type = accelerator {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.158950 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.159045 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.159268 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.159377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.159582 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.status_code_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.159682 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.159894 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.159995 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.160204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.160330 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.valid_interfaces = ['internal', 'public'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.160522 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.160629 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] cyborg.version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.160835 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.160937 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.backend = sqlalchemy {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.161160 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.161268 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection = **** {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.161472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.161574 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_debug = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.161786 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.161887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_parameters = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.162097 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.162217 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_recycle_time = 3600 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.162472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.162568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.connection_trace = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.163026 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.163690 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_inc_retry_interval = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.163863 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.163954 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retries = 20 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.164180 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_max_retry_interval = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.164404 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.164495 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.db_retry_interval = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.164743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.164845 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.max_overflow = 50 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.165081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.165215 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.max_pool_size = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.165380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.165481 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.max_retries = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.165726 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.165840 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_enable_ndb = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.166049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.166146 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.mysql_sql_mode = TRADITIONAL {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.166363 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.pool_timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.166455 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.166706 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.retry_interval = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.166803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.167029 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.167122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.slave_connection = **** {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.167339 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.167441 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] database.sqlite_synchronous = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.167653 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.167746 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.backend = sqlalchemy {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.167961 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.168057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection = **** {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.168268 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.168582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.168890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.169103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_debug = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.169191 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.169454 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_parameters = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.169547 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.169781 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_recycle_time = 3600 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.169871 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.170087 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.170177 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.connection_trace = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.170396 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.170492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_inc_retry_interval = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.170953 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.171089 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retries = 20 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.171216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.171331 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_max_retry_interval = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.171452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.171572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.db_retry_interval = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.171684 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.171802 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_overflow = 50 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.171921 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.172034 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_pool_size = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.172328 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.172645 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.max_retries = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.172779 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.172894 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_enable_ndb = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.173005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.173117 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.mysql_sql_mode = TRADITIONAL {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.173242 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.173355 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.pool_timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.173476 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.173589 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.retry_interval = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.173741 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.173960 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.slave_connection = **** {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.174100 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.174274 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] api_database.sqlite_synchronous = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.174410 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.174611 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] devices.enabled_mdev_types = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.174803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.175048 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.175155 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.cipher = aes-xts-plain64 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.175397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.175532 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.enabled = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.175706 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.175854 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ephemeral_storage_encryption.key_size = 512 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.176011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.176182 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.api_servers = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.176337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.176504 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.176645 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.176823 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.176956 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.177143 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.177244 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.177456 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.177555 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.177771 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.connect_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.177882 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.178091 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.debug = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.178193 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.178410 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.default_trusted_certificate_ids = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.178511 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.178802 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.179403 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_certificate_validation = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.179611 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.179718 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.enable_rbd_download = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.179923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.180026 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.endpoint_override = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.180228 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.180331 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.180538 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.180639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.180844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.180966 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.max_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.181162 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.181274 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.min_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.181475 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.181591 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.num_retries = 3 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.181778 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.181882 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_ceph_conf = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.182082 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.182177 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_connect_timeout = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.182393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.182495 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_pool = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.182726 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.182867 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.rbd_user = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.183044 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.183155 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.region_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.183351 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.183446 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.183657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.183757 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.service_type = image {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.183976 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.184080 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.184281 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.184375 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.184587 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.184695 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.status_code_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.184892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.184983 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.185206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.185301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.valid_interfaces = ['internal', 'public'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.185516 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.185617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.verify_glance_signatures = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.185819 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.185921 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] glance.version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.186143 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.186238 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] guestfs.debug = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.186456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.186551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_cdrom = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.186784 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.186887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.config_drive_inject_password = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.187098 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.187200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.dynamic_memory_ratio = 1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.187408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.187551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_instance_metrics_collection = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.187714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.187808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.enable_remotefx = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.188018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.188118 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.instances_path_share = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.188328 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.188435 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.iscsi_initiator_list = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.188650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.188745 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.limit_cpu_features = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.188966 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_count = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.189068 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.189266 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.189359 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.mounted_disk_query_retry_interval = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.189575 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.189669 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_check_timeframe = 60 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.189879 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.189983 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.power_state_event_polling_interval = 2 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.190186 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.190288 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.qemu_img_cmd = qemu-img.exe {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.190491 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.190585 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.use_multipath_io = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.190823 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.190949 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_count = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.191127 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.191239 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.volume_attach_retry_interval = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.191433 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.191548 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.vswitch_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.191733 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.191836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] hyperv.wait_soft_reboot_seconds = 60 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.192035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.192129 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] mks.enabled = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.192336 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.192619 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] mks.mksproxy_base_url = http://127.0.0.1:6090/ {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.192722 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.192954 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.193047 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.manager_interval = 2400 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.193258 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.193359 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.precache_concurrency = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.193563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.193669 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_base_images = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.193864 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.193966 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_original_minimum_age_seconds = 86400 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.194209 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.194411 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.remove_unused_resized_minimum_age_seconds = 3600 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.194545 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.194648 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] image_cache.subdirectory_name = _base {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.194944 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_max_retries = 60 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.195046 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.195252 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.195346 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.api_retry_interval = 2 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.195565 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_section = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.195659 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.195882 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.auth_type = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.195976 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.196194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.196289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.196506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.196599 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.196820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.196914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.197129 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.197230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.197442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.197544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.connect_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.197751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.endpoint_override = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.197850 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.198060 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.198154 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.198366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.198543 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.198671 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.198894 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.max_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.199001 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.199209 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.min_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.199303 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.199525 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.partition_key = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.199618 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.199847 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.peer_list = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.199949 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.200160 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.region_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.200267 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.200480 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.serial_console_state_timeout = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.200581 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.200791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.200893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.201123 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.service_type = baremetal {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.201217 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.201431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.201547 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.201744 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.201841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.202055 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.status_code_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.202146 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.202364 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.202463 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.202695 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.202789 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.valid_interfaces = ['internal', 'public'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.203025 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.203127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ironic.version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.203341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.203447 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.backend = nova.keymgr.conf_key_mgr.ConfKeyManager {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.203657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.203752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] key_manager.fixed_key = **** {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.203971 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.204067 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.auth_endpoint = http://localhost/identity/v3 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.204284 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.204391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_api_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.204602 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.204695 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.204915 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.205010 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_endpoint_type = public {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.205226 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.205329 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.barbican_region_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.205554 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.205648 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.205868 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.205969 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.206171 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.206272 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.206483 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.206575 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.206811 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.206908 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.207134 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.207236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.number_of_retries = 60 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.207443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.207545 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.retry_delay = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.207838 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.send_service_user_token = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.207936 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.208159 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.208254 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.208469 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.208563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.208774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.208866 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.209081 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican.verify_ssl_path = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.209175 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.209392 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.209484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_section = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.209702 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.auth_type = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.209803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.210526 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.210630 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.210857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.210962 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.211175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.211277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.211490 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.211584 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.211800 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.211898 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.212115 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.212220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.212425 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] barbican_service_user.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.212520 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.212748 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_role_id = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.212840 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.213058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.213160 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.approle_secret_id = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.213366 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.213460 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.213674 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.213765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.213978 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.214111 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.214284 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.214387 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.214596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.214721 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.214925 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.215020 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_mountpoint = secret {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.215247 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.215343 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.kv_version = 2 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.215554 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.namespace = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.215656 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.215863 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.root_token_id = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.215958 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.216178 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.216279 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.216485 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.ssl_ca_crt_file = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.216650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.216793 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.216964 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.217105 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.use_ssl = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.217277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.217432 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vault.vault_url = http://127.0.0.1:8200 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.217605 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.217752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.217925 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.218061 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.218251 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.218374 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.218557 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.218752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.218897 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.219131 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.connect_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.219236 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.219443 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.endpoint_override = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.219547 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.219758 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.219853 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.220064 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.220165 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.220373 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.max_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.220480 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.220680 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.min_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.220787 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.220986 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.region_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.221079 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.221293 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.221395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.221621 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.service_type = identity {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.221723 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.221935 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.222032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.222244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.222347 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.222555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.status_code_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.222648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.222887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.222978 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.223238 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.valid_interfaces = ['internal', 'public'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.223328 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.223550 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] keystone.version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.223650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.223893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.223985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.connection_uri = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.224198 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.224293 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_mode = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.224510 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.224603 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_model_extra_flags = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.224819 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.224926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.cpu_models = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.225129 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.225223 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_attempts = 8 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.225449 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.device_detach_timeout = 20 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.225542 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.226314 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.226433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_cachemodes = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.226633 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.disk_prefix = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.226774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.226971 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.227064 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.enabled_perf_events = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.227284 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.227392 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.file_backed_memory = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.227597 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.227691 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.gid_maps = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.227904 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.228008 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_disk_discard = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.228211 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.hw_machine_type = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.228314 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.228519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.228610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_ceph_conf = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.228841 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.228935 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_poll_interval = 15 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.229154 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_copy_timeout = 600 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.229259 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.229475 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.229569 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_glance_store_name = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.229797 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.229898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_rbd_pool = rbd {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.230102 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.230206 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_type = default {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.230417 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.images_volume_group = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.230517 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.230746 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.230854 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_key = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.231057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.231164 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_partition = -2 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.231364 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.231459 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.inject_password = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.231676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.231812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iscsi_iface = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.231983 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.iser_use_multipath = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.232078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.232300 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_bandwidth = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.232407 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.232622 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_completion_timeout = 800 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.232718 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.233104 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime = 500 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.233204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.233288 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_delay = 75 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.233374 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.237158 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.237272 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_downtime_steps = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.237272 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_inbound_addr = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.237432 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.237512 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_auto_converge = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.237594 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.237677 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_permit_post_copy = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.237751 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.237830 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_scheme = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.237903 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.237974 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_timeout_action = abort {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.238058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.238138 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_tunnelled = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.238212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.238283 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_uri = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.238409 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.238492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.live_migration_with_native_tls = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.238579 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.238653 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.max_queues = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.238770 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.238770 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.238912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.mem_stats_period_seconds = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.238994 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.239079 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_options = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.239153 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.239242 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.nfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.239317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.239388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_aoe_discover_tries = 3 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.239459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.239544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_iser_scan_tries = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.239624 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.239697 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_memory_encrypted_guests = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.239768 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.239846 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_nvme_discover_tries = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.239930 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240004 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_pcie_ports = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240074 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240145 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.num_volume_scan_tries = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240221 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240294 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.pmem_namespaces = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240373 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_client_cfg = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240516 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240516 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240643 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.quobyte_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240800 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_connect_timeout = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240873 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.240943 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retries = 12 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.241121 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.241276 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_destroy_volume_retry_interval = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.241476 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_secret_uuid = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.241590 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.241784 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.241878 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rbd_user = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.242099 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.realtime_scheduler_priority = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.242191 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.242417 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.242508 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.remote_filesystem_transport = ssh {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.242754 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_image_id = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.242850 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.243073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_kernel_id = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.243181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.243379 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rescue_ramdisk_id = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.243474 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.243691 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.243774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rng_dev_path = /dev/urandom {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.244004 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.rx_queue_size = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.244095 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.244317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.244438 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_options = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.244632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.244753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.smbfs_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.244950 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.245059 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_compression = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.245265 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.245369 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshot_image_format = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.245586 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.245753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.snapshots_directory = /opt/stack/data/nova/instances/snapshots {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.246075 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sparse_logical_volumes = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.246179 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.246394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_enabled = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.246497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.246753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_group = tss {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.246854 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.247085 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.swtpm_user = tss {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.247194 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.247403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.247506 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.sysinfo_serial = unique {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.247716 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.tx_queue_size = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.247836 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.248031 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.uid_maps = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.248345 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.248449 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.use_virtio_for_bridges = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.248659 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.248760 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.virt_type = kvm {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.248975 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.249078 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear = zero {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.249288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.249390 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_clear_size = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.249609 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.volume_use_multipath = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.249703 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.249922 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_cache_path = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.250025 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.250248 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.250348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_log_path = /var/log/vstorage/%(cluster_name)s/nova.log.gz {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.250576 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_group = qemu {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.250730 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.250921 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_opts = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.251021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.251250 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_perms = 0770 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.251352 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.251609 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.251715 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_point_base = /opt/stack/data/nova/mnt {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.251926 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.252030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.vzstorage_mount_user = stack {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.252285 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.252390 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] libvirt.wait_soft_reboot_seconds = 120 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.252602 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.252707 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_section = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.252911 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.253007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.auth_type = password {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.253231 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.253338 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.253546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.253815 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.253910 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.253994 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.254160 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.254262 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.254471 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.254640 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.connect_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.254840 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.254971 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.default_floating_pool = public {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.255115 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.255219 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.endpoint_override = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.255427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.255542 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.extension_sync_interval = 600 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.255738 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.255841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.http_retries = 3 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.256052 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.256147 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.256361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.256463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.256672 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.max_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.256768 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.257029 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.metadata_proxy_shared_secret = **** {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.257136 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.257339 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.min_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.257437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.257659 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.257752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.ovs_bridge = br-int {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.257976 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.physnets = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.258123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.258290 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.258397 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.region_name = RegionOne {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.258615 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_metadata_proxy = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.258842 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.258939 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.259162 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.259259 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.service_type = network {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.259497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.259593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.259823 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.259932 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.260151 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.260248 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.status_code_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.260460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.260564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.260775 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.260878 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.valid_interfaces = ['internal', 'public'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.261104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.261201 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] neutron.version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.261411 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.261507 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.bdms_in_notifications = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.261720 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.261842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.default_level = INFO {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.262032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.262128 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notification_format = unversioned {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.262344 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.262440 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.notify_on_state_change = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.262647 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.262830 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] notifications.versioned_notifications_topics = ['versioned_notifications'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.262995 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.263089 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] pci.alias = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.263309 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.263427 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] pci.device_spec = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.263613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.263718 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] pci.report_in_placement = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.263929 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.264033 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_section = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.264241 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.264356 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.auth_type = password {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.264597 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.264777 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.264907 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.265130 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.265265 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.265449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.265568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.265778 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.265919 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.connect_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.266105 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.266208 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.endpoint_override = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.266416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.266521 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.266750 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.266869 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.267066 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.max_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.267178 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.267372 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.min_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.267488 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.267679 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.267774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.region_name = RegionOne {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.267996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.268099 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.268308 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.268416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.service_type = placement {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.268618 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.268744 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.268926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.269039 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.269237 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.269355 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.status_code_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.269546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.269662 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.269850 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.269961 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.valid_interfaces = ['internal', 'public'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.270161 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.270273 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] placement.version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.270467 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.270578 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.cores = 20 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.270820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.270927 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.count_usage_from_placement = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.271130 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.271235 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.driver = nova.quota.DbQuotaDriver {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.271437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.271549 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_content_bytes = 10240 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.271743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.271852 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_file_path_length = 255 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.272061 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.272182 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.injected_files = 5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.272367 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.272968 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.instances = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.273187 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.273298 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.key_pairs = 100 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.273496 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.273603 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.metadata_items = 128 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.273803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.273898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.ram = 51200 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.274115 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.274232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.recheck_quota = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.274424 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.274525 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_group_members = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.274767 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] quota.server_groups = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.274865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.275094 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] rdp.enabled = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.275210 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.275444 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.275640 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] rdp.html5_proxy_base_url = http://127.0.0.1:6083/ {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.275799 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.275976 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.discover_hosts_in_cells_interval = -1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.276114 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.276298 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.enable_isolated_aggregate_filtering = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.276420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.276619 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.image_metadata_prefilter = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.276746 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.276942 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.limit_tenants_to_placement_aggregate = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.277051 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.277266 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_attempts = 3 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.277362 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.277587 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.max_placement_results = 1000 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.277681 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.277906 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.placement_aggregate_required_for_tenants = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.278015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.278224 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_availability_zone = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.278368 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.278542 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_image_type_support = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.278637 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.278884 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.279026 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.query_placement_for_routed_network_aggregates = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.279220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] scheduler.workers = 2 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.279318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.279536 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.279630 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_namespace = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.279870 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.aggregate_image_properties_isolation_separator = . {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.280076 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.280212 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.available_filters = ['nova.scheduler.filters.all_filters'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.280416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.280540 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.build_failure_weight_multiplier = 1000000.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.280741 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.280865 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cpu_weight_multiplier = 1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.281077 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.281192 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.cross_cell_move_weight_multiplier = 1000000.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.281411 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.281514 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.disk_weight_multiplier = 1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.281724 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.281866 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.enabled_filters = ['AvailabilityZoneFilter', 'ComputeFilter', 'ComputeCapabilitiesFilter', 'ImagePropertiesFilter', 'ServerGroupAntiAffinityFilter', 'ServerGroupAffinityFilter', 'SameHostFilter', 'DifferentHostFilter'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.282035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.282190 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.host_subset_size = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.282344 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.282504 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.image_properties_default_architecture = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.282670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.282851 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.io_ops_weight_multiplier = -1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.283008 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.283173 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_hosts = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.283324 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.283535 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.isolated_images = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.283730 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.283823 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_instances_per_host = 50 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.283936 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.284110 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.max_io_ops_per_host = 8 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.284249 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.284438 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.pci_weight_multiplier = 1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.284588 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.284759 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.ram_weight_multiplier = 1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.284899 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.285074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.restrict_isolated_hosts_to_isolated_images = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.285177 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.285390 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.shuffle_best_same_weighed_hosts = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.285486 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.285711 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_affinity_weight_multiplier = 1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.285814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.286032 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.soft_anti_affinity_weight_multiplier = 1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.286171 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.286352 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.286454 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.track_instance_changes = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.286665 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.286801 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] filter_scheduler.weight_classes = ['nova.scheduler.weights.all_weighers'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.286999 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.287104 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.required = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.287318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.287414 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_multiplier = 1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.287903 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_of_unavailable = -10000.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.288007 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.288282 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] metrics.weight_setting = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.288877 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.289092 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.289303 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.base_url = ws://127.0.0.1:6083/ {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.289397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.289630 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.enabled = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.289725 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.289972 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.port_range = 10000:20000 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.290068 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.290304 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.proxyclient_address = 127.0.0.1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.290398 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.290611 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.290739 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_host = 0.0.0.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.290949 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.291060 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] serial_console.serialproxy_port = 6083 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.291271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.291367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_section = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.291603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.291714 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.auth_type = password {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.291916 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.292009 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.292223 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.292316 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.292540 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.292647 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.292857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.292959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.293167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.293262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.293496 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.send_service_user_token = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.293621 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.293815 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.293922 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.294122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] service_user.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.294227 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.294451 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] spice.agent_enabled = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.294561 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.294791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] spice.enabled = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.294902 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.295118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.295336 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_base_url = http://127.0.0.1:6082/spice_auto.html {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.295446 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.295694 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_host = 0.0.0.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.295793 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.296018 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] spice.html5proxy_port = 6082 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.296115 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.296349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_listen = 127.0.0.1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.296457 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.296679 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] spice.server_proxyclient_address = 127.0.0.1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.296782 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.296995 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.297089 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.baseapi = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.297302 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.297406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.cert = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.297613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.297708 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.compute = auto {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.297926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.conductor = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.298027 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.298239 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] upgrade_levels.scheduler = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.298342 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.298546 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.298639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_section = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.298879 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.299014 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.auth_type = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.299189 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.299292 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.299497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.299603 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.299802 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.299905 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.300123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.300262 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.300413 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.300520 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.300718 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.300814 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.301024 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vendordata_dynamic_auth.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.301119 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.301324 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.301426 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.api_retry_count = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.301627 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.301737 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.ca_file = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.301933 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.302048 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cache_prefix = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.302236 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.302333 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.cluster_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.302538 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.302643 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.connection_pool_size = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.302868 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.302964 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.console_delay_seconds = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.303175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.datastore_regex = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.303281 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.303477 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.303630 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_ip = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.303806 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.303917 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_password = **** {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.304114 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.304222 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_port = 443 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.304417 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.304532 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.host_username = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.304719 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.304823 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.305051 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.305157 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.integration_bridge = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.305384 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.305480 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.maximum_objects = 100 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.305698 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.305794 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_default_policy = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.306018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.306120 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_enabled = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.306329 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.306426 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.pbm_wsdl_location = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.306650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.306784 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_log_dir = /opt/vmware/vspc {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.306984 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.307079 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_proxy_uri = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.307291 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.serial_port_service_uri = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.307394 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.307616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.task_poll_interval = 0.5 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.307719 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.307930 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.308024 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.use_linked_clone = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.308239 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.308335 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_keymap = en-us {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.308576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.308679 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port = 5900 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.308889 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.308994 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vmware.vnc_port_total = 10000 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.309203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.309305 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.auth_schemes = ['none'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.309517 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.309620 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.enabled = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.309830 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.310140 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_base_url = http://127.0.0.1:6080/vnc_auto.html {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.310244 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.310449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.310543 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_host = 0.0.0.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.310805 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.310907 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.novncproxy_port = 6080 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.311134 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.311231 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_listen = 127.0.0.1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.311443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.311546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.server_proxyclient_address = 127.0.0.1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.311771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.311873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_ca_certs = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.312082 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_cert = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.312177 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.312399 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] vnc.vencrypt_client_key = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.312498 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.312715 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.312821 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_compute_service_check_for_ffu = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.313031 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.313134 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_fallback_pcpu_query = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.313348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_group_policy_check_upcall = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.313449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.313661 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.313833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_libvirt_livesnapshot = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.313977 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.disable_rootwrap = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.314068 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.314290 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.314393 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_numa_live_migration = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.314601 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.314747 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.enable_qemu_monitor_announce_self = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.314945 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.ensure_libvirt_rbd_instance_dir_cleanup = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.315042 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.315262 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.handle_virt_lifecycle_events = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.315359 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.315578 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.315674 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.libvirt_disable_apic = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.315891 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.315986 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.never_download_image_if_on_rbd = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.316204 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.reserve_disk_resource_for_image_cache = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.316299 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.316520 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_cpu_compare_on_dest = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.316627 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.316837 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.skip_hypervisor_version_check_on_lm = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.316939 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.317153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.unified_limits_count_pcpu_as_vcpu = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.317249 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.317470 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.317565 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] workarounds.wait_for_vif_plugged_event_during_hard_reboot = [] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.317796 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.317902 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.api_paste_config = /etc/nova/api-paste.ini {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.318123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.318232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.client_socket_timeout = 900 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.318442 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.default_pool_size = 1000 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.318544 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.318788 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.keep_alive = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.318900 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.319114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.max_header_line = 16384 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.319221 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.319456 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.secure_proxy_ssl_header = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.319561 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.319773 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_ca_file = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.319867 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.320086 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.320189 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_cert_file = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.320396 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.320506 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.ssl_key_file = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.320642 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121046) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 08:04:31.320739 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.tcp_keepidle = 600 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.321035 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] wsgi.wsgi_log_format = %(client_ip)s "%(request_line)s" status: %(status_code)s len: %(body_length)s time: %(wall_seconds).7f {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.321357 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.ca_file = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.321669 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.cloud_connector_url = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.322092 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.image_tmp_path = /opt/stack/data/nova/images {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.322414 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] zvm.reachable_timeout = 300 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.322766 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_versionedobjects.fatal_exception_format_errors = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.323093 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_buffer_size = 1000 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.323411 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_enabled = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.323739 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_process_name = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.324068 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_socket_file = /var/tmp/metrics_collector.sock {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.324392 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_metrics.metrics_thread_stop_timeout = 10 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.324720 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_new_defaults = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.325037 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.enforce_scope = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.325369 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_default_rule = default {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.325715 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_dirs = ['policy.d'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.326049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.policy_file = policy.yaml {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.326376 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_content_type = application/x-www-form-urlencoded {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.326724 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_ca_crt_file = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.327021 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_crt_file = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.327331 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_client_key_file = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.327647 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_policy.remote_ssl_verify_server_crt = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.327977 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_section = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.328287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.auth_type = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.328596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.cafile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.328905 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.certfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.329220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.collect_timing = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.329529 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.329838 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.connect_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.330147 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_id = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.330455 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.endpoint_override = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.330793 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.insecure = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.331102 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.keyfile = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.331411 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.max_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.331720 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.min_version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.332027 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.region_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.332336 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_name = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.332644 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.service_type = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.332960 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.split_loggers = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.333266 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retries = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.333577 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.status_code_retry_delay = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.333884 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.timeout = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.334192 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.valid_interfaces = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.334504 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_limit.version = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.334870 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_middleware.http_basic_auth_user_file = /etc/htpasswd {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.335727 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.connection_string = messaging:// {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.336048 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.enabled = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.336374 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_doc_type = notification {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.336689 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_size = 10000 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.337015 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.es_scroll_time = 2m {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.337330 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.filter_error_trace = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.337654 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.hmac_keys = SECRET_KEY {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.337978 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.sentinel_service_name = mymaster {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.338300 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.socket_timeout = 0.1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.338614 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] profiler.trace_sqlalchemy = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.338978 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_auto_delete = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.339296 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.amqp_durable_queues = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.339615 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_min_size = 2 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.339932 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.conn_pool_ttl = 1200 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.340251 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.direct_mandatory_flag = True {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.340567 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.enable_cancel_on_failover = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.340884 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_in_pthread = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.341215 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_rate = 3 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.341545 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.heartbeat_timeout_threshold = 600 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.342306 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_compression = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.342306 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_failover_strategy = round-robin {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.342500 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_missing_consumer_retry_timeout = 60 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.342832 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.kombu_reconnect_delay = 1.0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.343158 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_ha_queues = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.343555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_interval_max = 30 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.343898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_login_method = AMQPLAIN {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.344121 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_qos_prefetch_count = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.344446 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_delivery_limit = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.344762 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quorum_queue = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.345079 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_bytes = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.345395 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_quroum_max_memory_length = 0 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.345721 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_backoff = 2 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.346038 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_retry_interval = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.346351 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rabbit_transient_queues_ttl = 1800 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.346734 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.rpc_conn_pool_size = 30 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.347017 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.347349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_ca_file = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.347679 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_cert_file = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.347996 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_enforce_fips_mode = False {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.348325 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_key_file = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.348655 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_rabbit.ssl_version = {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.349009 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.driver = ['messagingv2'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.349329 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.retry = -1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.349675 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.topics = ['notifications'] {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.350008 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_messaging_notifications.transport_url = **** {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.350326 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.351187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.file_event_handler_interval = 1 {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.351515 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] oslo_reports.log_dir = None {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2609}} Sep 16 08:04:31.351762 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi_app [-] ******************************************************************************** {{(pid=121047) log_opt_values /usr/local/lib/python3.8/dist-packages/oslo_config/cfg.py:2613}} Sep 16 08:04:31.381872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO dbcounter [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Registered counter for database nova_api Sep 16 08:04:31.402339 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_db.sqlalchemy.engines [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 08:04:31.408964 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writer thread running {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 08:04:31.414111 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO dbcounter [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Registered counter for database nova_api Sep 16 08:04:31.434734 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_db.sqlalchemy.engines [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 08:04:31.441360 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writer thread running {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 08:04:31.465174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.context [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43(cell1) {{(pid=121046) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 08:04:31.469214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:04:31.469689 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:04:31.471288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:04:31.472010 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:04:31.472453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:04:31.474454 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:04:31.477011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO dbcounter [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Registered counter for database nova_cell0 Sep 16 08:04:31.481015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO dbcounter [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Registered counter for database nova_cell1 Sep 16 08:04:31.489586 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_db.sqlalchemy.engines [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 08:04:31.490533 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_db.sqlalchemy.engines [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 08:04:31.495728 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writer thread running {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 08:04:31.500742 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.context [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Found 2 cells: 00000000-0000-0000-0000-000000000000(cell0),5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43(cell1) {{(pid=121047) load_cells /opt/stack/nova/nova/context.py:464}} Sep 16 08:04:31.517027 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:04:31.517027 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:04:31.517027 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:04:31.517027 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:04:31.517027 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:04:31.517556 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:04:31.517556 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO dbcounter [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Registered counter for database nova_cell0 Sep 16 08:04:31.517556 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO dbcounter [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Registered counter for database nova_cell1 Sep 16 08:04:31.526585 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_db.sqlalchemy.engines [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 08:04:31.527422 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_db.sqlalchemy.engines [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 08:04:31.534912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writer thread running {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 08:04:31.536423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writer thread running {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 08:04:31.722901 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writer thread running {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 08:04:31.722901 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO dbcounter [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Registered counter for database nova_cell0 Sep 16 08:04:31.722901 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_db.sqlalchemy.engines [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121046) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 08:04:31.722901 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writer thread running {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 08:04:31.729312 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO dbcounter [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Registered counter for database nova_cell0 Sep 16 08:04:31.737405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_db.sqlalchemy.engines [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] MySQL server mode set to STRICT_TRANS_TABLES,STRICT_ALL_TABLES,NO_ZERO_IN_DATE,NO_ZERO_DATE,ERROR_FOR_DIVISION_BY_ZERO,TRADITIONAL,NO_ENGINE_SUBSTITUTION {{(pid=121047) _check_effective_sql_mode /usr/local/lib/python3.8/dist-packages/oslo_db/sqlalchemy/engines.py:314}} Sep 16 08:04:31.746506 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writer thread running {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:99}} Sep 16 08:04:32.005571 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: WARNING keystonemiddleware.auth_token [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 08:04:32.013530 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: WARNING keystonemiddleware.auth_token [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 08:04:32.080349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: WARNING keystonemiddleware.auth_token [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 08:04:32.088617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: WARNING keystonemiddleware.auth_token [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 08:04:32.358111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: WARNING keystonemiddleware.auth_token [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 08:04:32.364379 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: WARNING keystonemiddleware.auth_token [None req-b6aa64c8-1abe-435d-acd1-965d898072bc None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 08:04:32.370536 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561484ea89c0 pid: 121046 (default app) Sep 16 08:04:32.438839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: WARNING keystonemiddleware.auth_token [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] AuthToken middleware is set with keystone_authtoken.service_token_roles_required set to False. This is backwards compatible but deprecated behaviour. Please set this to True. Sep 16 08:04:32.444987 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: WARNING keystonemiddleware.auth_token [None req-2282e5fa-6db8-4ad4-bf38-d92392160d2f None None] Configuring www_authenticate_uri to point to the public identity endpoint is required; clients may not be able to authenticate against an admin endpoint Sep 16 08:04:32.450349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: WSGI app 0 (mountpoint='') ready in 6 seconds on interpreter 0x561484ea89c0 pid: 121047 (default app) Sep 16 08:05:12.420688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3866e8c8-b0f3-4587-a5cd-0735d5d765e7 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] Calling method '.version_select at 0x7f9d07afdf70>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:12.449180 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:12.450033 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:12.450952 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:12.451744 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:13.315810 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3866e8c8-b0f3-4587-a5cd-0735d5d765e7 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/5fb77566-ec1d-4ec0-944b-0a407eed5d8f" status: 200 len: 350 microversion: 2.1 time: 1.179279 Sep 16 08:05:13.316528 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 1/1] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:05:12 2022] GET /compute/v2.1/os-volumes/5fb77566-ec1d-4ec0-944b-0a407eed5d8f => generated 350 bytes in 1182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:15.572175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=3 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:15.573152 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=3 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:15.574160 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=3 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:15.580834 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=3 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:16.148221 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c5cff204-76e3-4712-88da-da2be30fbb79 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] Calling method '.version_select at 0x7f9d07b06940>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:17.028936 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c5cff204-76e3-4712-88da-da2be30fbb79 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/77c0b82c-8644-4a60-bcad-637c879a607a" status: 200 len: 351 microversion: 2.1 time: 1.464817 Sep 16 08:05:17.029817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 1/2] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:05:15 2022] GET /compute/v2.1/os-volumes/77c0b82c-8644-4a60-bcad-637c879a607a => generated 351 bytes in 1467 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:21.478577 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d69e535e-0112-47cf-9585-4c27a774bd59 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: .version_select at 0x7f9d07904310>, body: {"keypair": {"name": "tempest-keypair-750192348", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBF8g+AmS8Nt45TpH1JcEEcx2PyDefe01yBYkFHdLsc+zGOWhN3TPeHYlo6WNiisPQFjltDZo4vbpuK1SjXkNhs/KMA1qsoqHGOadgXvIWp5h96E8t1PurcrNSdMAmpxPQ=="}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:05:21.656917 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-d69e535e-0112-47cf-9585-4c27a774bd59 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for project b807736ef6c54be2b4715f32a4cfea57. Resources: {'key_pairs'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:05:21.707846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-d69e535e-0112-47cf-9585-4c27a774bd59 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for user ea2f6b804e164dbcb4f67926f23fdd59 and project b807736ef6c54be2b4715f32a4cfea57. Resources: {'key_pairs'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:05:21.831153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9d9aa09b-b8dc-49b3-9c4e-e2189c0d667e tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] Calling method '.version_select at 0x7f9d07914280>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:21.985899 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9d9aa09b-b8dc-49b3-9c4e-e2189c0d667e tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/6c9f9155-9388-461f-b6c8-bd5d382aa9be" status: 200 len: 351 microversion: 2.1 time: 0.136164 Sep 16 08:05:21.987801 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d69e535e-0112-47cf-9585-4c27a774bd59 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 1.122766 Sep 16 08:05:22.007086 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 2/3] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:05:21 2022] GET /compute/v2.1/os-volumes/6c9f9155-9388-461f-b6c8-bd5d382aa9be => generated 351 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:05:22.019715 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 2/4] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Sep 16 08:05:20 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:22.031779 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-25bb4887-c320-4abf-95b2-4c7aae65ff99 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] Calling method '.version_select at 0x7f9d079149d0>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:22.251352 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-25bb4887-c320-4abf-95b2-4c7aae65ff99 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.242698 Sep 16 08:05:22.252010 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 3/5] 10.222.0.59 () {58 vars in 1134 bytes} [Fri Sep 16 08:05:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:22.272153 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-879b4f0c-c0d3-4508-ab90-3b8413610a57 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] Calling method '.version_select at 0x7f9d078930d0>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:22.387392 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-879b4f0c-c0d3-4508-ab90-3b8413610a57 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.119118 Sep 16 08:05:22.412515 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 3/6] 10.222.0.59 () {58 vars in 1149 bytes} [Fri Sep 16 08:05:22 2022] GET /compute/v2.1/os-volumes?limit=2 => generated 695 bytes in 121 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:22.415469 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6f24c6dc-8c53-423b-b321-47ca54f88d81 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] Calling method '.version_select at 0x7f9d079145e0>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:22.578659 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6f24c6dc-8c53-423b-b321-47ca54f88d81 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] 10.222.0.59 "GET /compute/v2.1/os-volumes" status: 200 len: 1035 microversion: 2.1 time: 0.173975 Sep 16 08:05:22.586208 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 4/7] 10.222.0.59 () {58 vars in 1134 bytes} [Fri Sep 16 08:05:22 2022] GET /compute/v2.1/os-volumes => generated 1035 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:22.603791 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-337acc49-c419-4b47-8da4-492f15ee6c59 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] Calling method '.version_select at 0x7f9d0783c9d0>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:22.770632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-337acc49-c419-4b47-8da4-492f15ee6c59 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] 10.222.0.59 "GET /compute/v2.1/os-volumes?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.172714 Sep 16 08:05:22.772174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 4/8] 10.222.0.59 () {58 vars in 1167 bytes} [Fri Sep 16 08:05:22 2022] GET /compute/v2.1/os-volumes?offset=1&limit=1 => generated 354 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:22.788648 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4cda4d4d-7860-4dbb-bea6-ecd3eae88650 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] Calling method '.version_select at 0x7f9d07934550>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:23.007640 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4cda4d4d-7860-4dbb-bea6-ecd3eae88650 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?limit=2" status: 200 len: 695 microversion: 2.1 time: 0.223265 Sep 16 08:05:23.009365 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 5/9] 10.222.0.59 () {58 vars in 1170 bytes} [Fri Sep 16 08:05:22 2022] GET /compute/v2.1/os-volumes/detail?limit=2 => generated 695 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:23.023720 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cccdbbe7-a929-456b-b880-e77be5da149e tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] Calling method '.version_select at 0x7f9d0783cd30>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:23.357130 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cccdbbe7-a929-456b-b880-e77be5da149e tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.337766 Sep 16 08:05:23.357709 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 5/10] 10.222.0.59 () {58 vars in 1155 bytes} [Fri Sep 16 08:05:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 339 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:23.372438 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3819a50a-6b99-43bb-9900-6d868946b037 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] Calling method '.version_select at 0x7f9d07914a60>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:23.511757 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3819a50a-6b99-43bb-9900-6d868946b037 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail?offset=1&limit=1" status: 200 len: 354 microversion: 2.1 time: 0.143570 Sep 16 08:05:23.512877 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 6/11] 10.222.0.59 () {58 vars in 1188 bytes} [Fri Sep 16 08:05:23 2022] GET /compute/v2.1/os-volumes/detail?offset=1&limit=1 => generated 354 bytes in 145 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:23.527088 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-438b5199-d9af-4a92-85c4-0998d47a1402 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] Calling method '.version_select at 0x7f9d07893b80>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:23.783341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-438b5199-d9af-4a92-85c4-0998d47a1402 tempest-VolumesTestJSON-880479217 tempest-VolumesTestJSON-880479217-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/detail" status: 200 len: 1035 microversion: 2.1 time: 0.261086 Sep 16 08:05:23.787922 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 6/12] 10.222.0.59 () {58 vars in 1155 bytes} [Fri Sep 16 08:05:23 2022] GET /compute/v2.1/os-volumes/detail => generated 1035 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:25.814405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-DeleteServersTestJSON-server-1307747177", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "networks": [{"uuid": "f5a5aeb2-4566-4b20-b1c6-c2f6f3bc5583"}]}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:05:26.045700 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.network.neutron [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] validate_networks() for [('f5a5aeb2-4566-4b20-b1c6-c2f6f3bc5583', None, None, None, None, None)] {{(pid=121047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:05:27.110007 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-1147667021", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:05:27.293808 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.network.neutron [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] validate_networks() for [('24df6cf0-63a8-4e5b-a9ad-1254d9c28362', None, None, None, None, None)] {{(pid=121046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:05:28.356287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Flavor limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:05:28.356843 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Image limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:05:28.357170 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Flavor pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:05:28.360129 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Image pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:05:28.360129 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:05:28.386500 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:28.387028 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:28.391460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:28.392391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:28.393020 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:28.393609 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:28.477760 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Getting quotas for project 48c466a9c78b46db90b2c979cf885f43. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:05:28.516781 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Getting quotas for user ae3824cef26941278065945a8ee37d32 and project 48c466a9c78b46db90b2c979cf885f43. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:05:28.568677 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Going to run 1 instances... {{(pid=121047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:05:28.574085 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:05:28.745949 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Flavor limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:05:28.746452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Image limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:05:28.747100 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Flavor pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:05:28.747529 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Image pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:05:28.747951 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:05:28.817893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:28.818435 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:28.819447 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:28.820259 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:28.820722 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:28.821160 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:28.874751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6b064a8c-20be-4cd2-893e-d97a5a02a160 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 3.493495 Sep 16 08:05:28.882090 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 7/13] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:05:25 2022] POST /compute/v2.1/servers => generated 380 bytes in 3500 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:05:28.890444 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Getting quotas for project f143f731c6cc4b38ba979827cd390f77. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:05:28.896756 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Getting quotas for user 5a85cff936184b5d94375fd103493950 and project f143f731c6cc4b38ba979827cd390f77. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:05:28.920714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Going to run 1 instances... {{(pid=121046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:05:28.925584 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:05:29.024870 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ac0a8db4-a34e-4010-bca0-c77d179ac146 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Action: 'create', calling method: .version_select at 0x7f9d06fc73a0>, body: {"keypair": {"name": "tempest-keypair-81381970", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBHw3Te0M0/V+6gI3miCvl/ea8EUKDXJ9Y2SZH9LHrF6+4Ym86STG1ZlnxU4opUCyrnZQryrv86ZVR7fApzh+4tNLaSwkec+aSisZ/ccCCsA7rUdh0uxLg5h2NyZzLyf/kQ=="}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:05:29.074833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-ac0a8db4-a34e-4010-bca0-c77d179ac146 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Getting quotas for project 45838a0f741e485e8f424375c6d0d489. Resources: {'key_pairs'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:05:29.085222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-27716c96-edae-4ec1-a07b-dbbae56c8cdb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 2.103753 Sep 16 08:05:29.086449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 7/14] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:05:26 2022] POST /compute/v2.1/servers => generated 383 bytes in 2106 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:05:29.090231 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-ac0a8db4-a34e-4010-bca0-c77d179ac146 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Getting quotas for user 393fddf9c75447fab334b84694dcf4f1 and project 45838a0f741e485e8f424375c6d0d489. Resources: {'key_pairs'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:05:29.096214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-96bae18a-0ec1-4033-827e-e36dd5b4a9e5 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:29.098794 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-96bae18a-0ec1-4033-827e-e36dd5b4a9e5 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:29.242136 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ac0a8db4-a34e-4010-bca0-c77d179ac146 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 384 microversion: 2.1 time: 0.351002 Sep 16 08:05:29.243485 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 8/15] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Sep 16 08:05:28 2022] POST /compute/v2.1/os-keypairs => generated 384 bytes in 362 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:29.248732 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1e739eb2-8a66-4e8a-b6ff-6786b9009a6d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:29.267369 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1e739eb2-8a66-4e8a-b6ff-6786b9009a6d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:29.295989 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-96bae18a-0ec1-4033-827e-e36dd5b4a9e5 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:29.331361 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-96bae18a-0ec1-4033-827e-e36dd5b4a9e5 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1215 microversion: 2.1 time: 0.237607 Sep 16 08:05:29.332804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 8/16] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:29 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1215 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:29.339487 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-971805730", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08ca5f04-b5f0-4538-b476-9e48665ae12b"}], "security_groups": [{"name": "tempest-securitygroup--948040452"}], "key_name": "tempest-keypair-750192348", "user_data": "}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:05:29.426433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1e739eb2-8a66-4e8a-b6ff-6786b9009a6d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:29.455813 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1e739eb2-8a66-4e8a-b6ff-6786b9009a6d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1222 microversion: 2.1 time: 0.211162 Sep 16 08:05:29.475973 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 9/17] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:29 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1222 bytes in 229 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:29.547962 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-662073398", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "}]}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:05:29.571389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.network.neutron [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] validate_networks() for [('08ca5f04-b5f0-4538-b476-9e48665ae12b', None, None, None, None, None)] {{(pid=121046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:05:29.654930 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.network.neutron [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] validate_networks() for [('24df6cf0-63a8-4e5b-a9ad-1254d9c28362', None, None, None, None, None)] {{(pid=121047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:05:30.163193 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Flavor limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:05:30.163678 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Image limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:05:30.164099 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Flavor pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:05:30.164517 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Image pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:05:30.164939 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:05:30.177289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:30.178029 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:30.180517 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:30.181450 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:30.182079 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:30.183602 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:30.205436 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for project b807736ef6c54be2b4715f32a4cfea57. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:05:30.211283 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for user ea2f6b804e164dbcb4f67926f23fdd59 and project b807736ef6c54be2b4715f32a4cfea57. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:05:30.225178 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Going to run 1 instances... {{(pid=121046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:05:30.228237 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:05:30.472252 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8bcde459-bfa7-4493-9e53-1ff237e7cb43 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 1.131428 Sep 16 08:05:30.478764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 9/18] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:05:29 2022] POST /compute/v2.1/servers => generated 401 bytes in 1145 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:05:30.502813 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-db4e9dd9-4e29-41a7-ae97-b24229576b64 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:30.503662 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-db4e9dd9-4e29-41a7-ae97-b24229576b64 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:30.585985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-db4e9dd9-4e29-41a7-ae97-b24229576b64 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:30.605969 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-db4e9dd9-4e29-41a7-ae97-b24229576b64 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1215 microversion: 2.1 time: 0.117107 Sep 16 08:05:30.607764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 10/19] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:30 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1215 bytes in 128 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:30.613306 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3340f39e-ae39-4d4d-aabb-4b78af2ea9cb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:30.614298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3340f39e-ae39-4d4d-aabb-4b78af2ea9cb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:30.734999 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3340f39e-ae39-4d4d-aabb-4b78af2ea9cb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:30.743478 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3340f39e-ae39-4d4d-aabb-4b78af2ea9cb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1240 microversion: 2.1 time: 0.133932 Sep 16 08:05:30.758706 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 11/20] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:30 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1240 bytes in 137 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:30.951638 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Flavor limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:05:30.952751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Image limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:05:30.953600 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Flavor pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:05:30.954172 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Image pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:05:30.954770 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:05:30.985231 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:30.985743 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:30.986196 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:30.992005 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:30.992547 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:30.999314 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:31.048064 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Getting quotas for project f143f731c6cc4b38ba979827cd390f77. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:05:31.053624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Getting quotas for user 5a85cff936184b5d94375fd103493950 and project f143f731c6cc4b38ba979827cd390f77. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:05:31.075551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Going to run 1 instances... {{(pid=121047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:05:31.079884 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:05:31.310453 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3792f8da-7e99-4f83-9b32-e03b4bbe9523 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 383 microversion: 2.1 time: 1.767783 Sep 16 08:05:31.312772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 10/21] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:05:29 2022] POST /compute/v2.1/servers => generated 383 bytes in 1771 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 08:05:31.329103 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6473de5c-a033-455f-8526-157fd38da4d4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:31.329731 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6473de5c-a033-455f-8526-157fd38da4d4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:31.636319 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-24ef508a-f210-4659-9bee-4b67de845ae6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:31.637021 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-24ef508a-f210-4659-9bee-4b67de845ae6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:31.954771 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-24ef508a-f210-4659-9bee-4b67de845ae6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:31.992926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-24ef508a-f210-4659-9bee-4b67de845ae6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1215 microversion: 2.1 time: 0.363074 Sep 16 08:05:32.006988 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 11/22] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:31 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1215 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:32.024564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6473de5c-a033-455f-8526-157fd38da4d4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:32.028734 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-738303a8-eda6-4167-83aa-28d062b9e6ee tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:32.035633 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-738303a8-eda6-4167-83aa-28d062b9e6ee tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:32.037018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6473de5c-a033-455f-8526-157fd38da4d4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1221 microversion: 2.1 time: 0.714629 Sep 16 08:05:32.038663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 12/23] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:31 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1221 bytes in 719 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:32.298944 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-738303a8-eda6-4167-83aa-28d062b9e6ee tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:32.318388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-738303a8-eda6-4167-83aa-28d062b9e6ee tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1240 microversion: 2.1 time: 0.307905 Sep 16 08:05:32.320432 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 12/24] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:32 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1240 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:33.023722 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-699238b9-775e-4552-88a9-cc0e635a5b81 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:33.025072 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-699238b9-775e-4552-88a9-cc0e635a5b81 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:33.032114 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-699238b9-775e-4552-88a9-cc0e635a5b81 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:33.032832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-699238b9-775e-4552-88a9-cc0e635a5b81 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:33.033449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-699238b9-775e-4552-88a9-cc0e635a5b81 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:33.034323 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-699238b9-775e-4552-88a9-cc0e635a5b81 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:33.035107 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-699238b9-775e-4552-88a9-cc0e635a5b81 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:33.035708 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-699238b9-775e-4552-88a9-cc0e635a5b81 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:33.063887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2d6c2954-52b3-4e6e-9ae8-cee9c8593a93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:33.065578 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2d6c2954-52b3-4e6e-9ae8-cee9c8593a93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:33.344032 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2d6c2954-52b3-4e6e-9ae8-cee9c8593a93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:33.359117 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2d6c2954-52b3-4e6e-9ae8-cee9c8593a93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1221 microversion: 2.1 time: 0.299027 Sep 16 08:05:33.359723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 13/25] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:33 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1221 bytes in 300 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:33.374671 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-23cc1f7a-2f0e-4c61-be04-9e5ec8327877 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:33.379640 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-23cc1f7a-2f0e-4c61-be04-9e5ec8327877 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:33.391907 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-23cc1f7a-2f0e-4c61-be04-9e5ec8327877 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:33.392662 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-23cc1f7a-2f0e-4c61-be04-9e5ec8327877 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:33.394033 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-23cc1f7a-2f0e-4c61-be04-9e5ec8327877 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:33.396095 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-23cc1f7a-2f0e-4c61-be04-9e5ec8327877 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:33.407616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-23cc1f7a-2f0e-4c61-be04-9e5ec8327877 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:33.408086 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-23cc1f7a-2f0e-4c61-be04-9e5ec8327877 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:33.656412 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-699238b9-775e-4552-88a9-cc0e635a5b81 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:33.676405 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-699238b9-775e-4552-88a9-cc0e635a5b81 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1219 microversion: 2.1 time: 0.656625 Sep 16 08:05:33.703068 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 13/26] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:33 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1219 bytes in 685 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:33.925751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-23cc1f7a-2f0e-4c61-be04-9e5ec8327877 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:33.952469 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-23cc1f7a-2f0e-4c61-be04-9e5ec8327877 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1244 microversion: 2.1 time: 0.591506 Sep 16 08:05:33.970026 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 14/27] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:33 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1244 bytes in 610 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:34.391280 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dfc01683-bd77-49f6-9f9c-ec58beb66e05 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:34.391892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dfc01683-bd77-49f6-9f9c-ec58beb66e05 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:34.409012 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dfc01683-bd77-49f6-9f9c-ec58beb66e05 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:34.409724 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dfc01683-bd77-49f6-9f9c-ec58beb66e05 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:34.410316 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dfc01683-bd77-49f6-9f9c-ec58beb66e05 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:34.411464 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dfc01683-bd77-49f6-9f9c-ec58beb66e05 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:34.412124 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dfc01683-bd77-49f6-9f9c-ec58beb66e05 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:34.413281 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dfc01683-bd77-49f6-9f9c-ec58beb66e05 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:34.533613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dfc01683-bd77-49f6-9f9c-ec58beb66e05 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:34.549740 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dfc01683-bd77-49f6-9f9c-ec58beb66e05 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1217 microversion: 2.1 time: 0.165709 Sep 16 08:05:34.550442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 14/28] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:34 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1217 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:34.699243 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-01bd80f1-e6ad-405d-a4f7-8aa4a042178d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:34.700400 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-01bd80f1-e6ad-405d-a4f7-8aa4a042178d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:34.707554 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01bd80f1-e6ad-405d-a4f7-8aa4a042178d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:34.708281 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01bd80f1-e6ad-405d-a4f7-8aa4a042178d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:34.708877 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01bd80f1-e6ad-405d-a4f7-8aa4a042178d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:34.710353 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01bd80f1-e6ad-405d-a4f7-8aa4a042178d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:34.711000 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01bd80f1-e6ad-405d-a4f7-8aa4a042178d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:34.711790 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01bd80f1-e6ad-405d-a4f7-8aa4a042178d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:34.956721 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-01bd80f1-e6ad-405d-a4f7-8aa4a042178d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:34.979518 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5f75c1d4-94f0-421c-bf0b-cd44590c1627 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:34.980407 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5f75c1d4-94f0-421c-bf0b-cd44590c1627 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:34.982998 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-01bd80f1-e6ad-405d-a4f7-8aa4a042178d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1211 microversion: 2.1 time: 0.288014 Sep 16 08:05:34.995863 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 15/29] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:34 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1211 bytes in 302 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:35.011476 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f75c1d4-94f0-421c-bf0b-cd44590c1627 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:35.012121 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f75c1d4-94f0-421c-bf0b-cd44590c1627 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:35.014904 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f75c1d4-94f0-421c-bf0b-cd44590c1627 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:35.015772 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f75c1d4-94f0-421c-bf0b-cd44590c1627 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:35.016904 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f75c1d4-94f0-421c-bf0b-cd44590c1627 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:35.020074 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f75c1d4-94f0-421c-bf0b-cd44590c1627 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:35.105859 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5f75c1d4-94f0-421c-bf0b-cd44590c1627 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:35.114497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5f75c1d4-94f0-421c-bf0b-cd44590c1627 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1236 microversion: 2.1 time: 0.141243 Sep 16 08:05:35.115728 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 15/30] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:34 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1236 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:35.544666 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-189477836", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6b86e2a-3872-426c-a67d-323df7f17364"}], "security_groups": [{"name": "tempest-securitygroup--1940078975"}], "key_name": "tempest-keypair-81381970", "user_data": "}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:05:35.577409 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3c5def96-ac23-46be-a414-b5b68981af11 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:35.578581 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3c5def96-ac23-46be-a414-b5b68981af11 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:35.600970 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c5def96-ac23-46be-a414-b5b68981af11 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:35.603656 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c5def96-ac23-46be-a414-b5b68981af11 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:35.604156 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c5def96-ac23-46be-a414-b5b68981af11 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:35.607350 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c5def96-ac23-46be-a414-b5b68981af11 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:35.609796 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c5def96-ac23-46be-a414-b5b68981af11 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:35.611867 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c5def96-ac23-46be-a414-b5b68981af11 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:35.833549 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3c5def96-ac23-46be-a414-b5b68981af11 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:35.851313 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3c5def96-ac23-46be-a414-b5b68981af11 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1217 microversion: 2.1 time: 0.278847 Sep 16 08:05:35.901347 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 16/31] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:35 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1217 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:36.016059 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ae308929-c22f-4063-aa81-19f45c6c901e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:36.016889 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ae308929-c22f-4063-aa81-19f45c6c901e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:36.026159 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.network.neutron [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] validate_networks() for [('f6b86e2a-3872-426c-a67d-323df7f17364', None, None, None, None, None)] {{(pid=121047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:05:36.028477 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ae308929-c22f-4063-aa81-19f45c6c901e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:36.029322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ae308929-c22f-4063-aa81-19f45c6c901e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:36.030507 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ae308929-c22f-4063-aa81-19f45c6c901e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:36.032022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ae308929-c22f-4063-aa81-19f45c6c901e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:36.033273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ae308929-c22f-4063-aa81-19f45c6c901e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:36.033998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ae308929-c22f-4063-aa81-19f45c6c901e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:36.495841 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ae308929-c22f-4063-aa81-19f45c6c901e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:36.506201 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ae308929-c22f-4063-aa81-19f45c6c901e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1275 microversion: 2.1 time: 0.500510 Sep 16 08:05:36.506822 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 17/32] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:36 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1275 bytes in 502 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:36.521170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ab80a34a-324d-479c-9404-a2ea07fd03da tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:36.522539 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ab80a34a-324d-479c-9404-a2ea07fd03da tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:36.535976 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab80a34a-324d-479c-9404-a2ea07fd03da tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:36.536695 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab80a34a-324d-479c-9404-a2ea07fd03da tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:36.537842 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab80a34a-324d-479c-9404-a2ea07fd03da tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:36.547665 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab80a34a-324d-479c-9404-a2ea07fd03da tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:36.548361 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab80a34a-324d-479c-9404-a2ea07fd03da tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:36.549080 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab80a34a-324d-479c-9404-a2ea07fd03da tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:36.663140 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ab80a34a-324d-479c-9404-a2ea07fd03da tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:36.680012 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ab80a34a-324d-479c-9404-a2ea07fd03da tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1292 microversion: 2.1 time: 0.171986 Sep 16 08:05:36.680839 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 18/33] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:36 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1292 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:36.926278 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7fe170c4-4294-4c50-b039-b54132cf4e56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:36.926278 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7fe170c4-4294-4c50-b039-b54132cf4e56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:36.931107 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7fe170c4-4294-4c50-b039-b54132cf4e56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:36.934440 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7fe170c4-4294-4c50-b039-b54132cf4e56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:36.935474 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7fe170c4-4294-4c50-b039-b54132cf4e56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:36.938643 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7fe170c4-4294-4c50-b039-b54132cf4e56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:36.941969 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7fe170c4-4294-4c50-b039-b54132cf4e56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:36.942723 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7fe170c4-4294-4c50-b039-b54132cf4e56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:37.251940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Flavor limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:05:37.255284 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Image limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:05:37.258956 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Flavor pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:05:37.262200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Image pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:05:37.264481 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:05:37.339552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:37.344460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:37.349358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:37.350708 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:37.356459 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:37.357715 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:37.445126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Getting quotas for project 45838a0f741e485e8f424375c6d0d489. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:05:37.454403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7fe170c4-4294-4c50-b039-b54132cf4e56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:37.471733 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Getting quotas for user 393fddf9c75447fab334b84694dcf4f1 and project 45838a0f741e485e8f424375c6d0d489. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:05:37.472662 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7fe170c4-4294-4c50-b039-b54132cf4e56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1217 microversion: 2.1 time: 0.554711 Sep 16 08:05:37.493021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 19/34] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:36 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1217 bytes in 576 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:37.524685 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Going to run 1 instances... {{(pid=121047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:05:37.534698 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2632fadb-733d-44a3-85ed-eea3931bb41b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:37.535936 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2632fadb-733d-44a3-85ed-eea3931bb41b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:37.539122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:05:37.558888 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2632fadb-733d-44a3-85ed-eea3931bb41b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:37.559942 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2632fadb-733d-44a3-85ed-eea3931bb41b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:37.568003 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2632fadb-733d-44a3-85ed-eea3931bb41b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:37.583613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2632fadb-733d-44a3-85ed-eea3931bb41b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:37.591111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2632fadb-733d-44a3-85ed-eea3931bb41b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.016s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:37.595137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2632fadb-733d-44a3-85ed-eea3931bb41b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:37.919406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-05fe896d-4c2f-45a5-a0a6-efe96e55a7b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 2.381888 Sep 16 08:05:37.925127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 16/35] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:05:35 2022] POST /compute/v2.1/servers => generated 402 bytes in 2388 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:05:37.944767 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b57297d0-7b33-4923-b46f-03ff5c3628ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:37.945799 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b57297d0-7b33-4923-b46f-03ff5c3628ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:37.983868 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b57297d0-7b33-4923-b46f-03ff5c3628ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:37.983868 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b57297d0-7b33-4923-b46f-03ff5c3628ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:37.983868 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b57297d0-7b33-4923-b46f-03ff5c3628ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:37.983868 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b57297d0-7b33-4923-b46f-03ff5c3628ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:37.984388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b57297d0-7b33-4923-b46f-03ff5c3628ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:37.984388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b57297d0-7b33-4923-b46f-03ff5c3628ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:38.284940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b57297d0-7b33-4923-b46f-03ff5c3628ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:38.305435 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b57297d0-7b33-4923-b46f-03ff5c3628ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1300 microversion: 2.1 time: 0.378401 Sep 16 08:05:38.307092 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 17/36] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:37 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1300 bytes in 381 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:38.322931 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9c90b41e-364d-478e-8f47-5a48f2457920 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:38.323935 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9c90b41e-364d-478e-8f47-5a48f2457920 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:38.335122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2632fadb-733d-44a3-85ed-eea3931bb41b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:38.345278 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2632fadb-733d-44a3-85ed-eea3931bb41b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1273 microversion: 2.1 time: 0.813744 Sep 16 08:05:38.367558 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 20/37] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:37 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1273 bytes in 838 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:38.506767 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-510aa399-4d57-4740-b53a-e43d30564c31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:38.507396 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-510aa399-4d57-4740-b53a-e43d30564c31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:38.523265 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-510aa399-4d57-4740-b53a-e43d30564c31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:38.524128 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-510aa399-4d57-4740-b53a-e43d30564c31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:38.527596 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-510aa399-4d57-4740-b53a-e43d30564c31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:38.539308 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-510aa399-4d57-4740-b53a-e43d30564c31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:38.541801 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-510aa399-4d57-4740-b53a-e43d30564c31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:38.542463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-510aa399-4d57-4740-b53a-e43d30564c31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:38.633280 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9c90b41e-364d-478e-8f47-5a48f2457920 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:38.640410 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9c90b41e-364d-478e-8f47-5a48f2457920 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1235 microversion: 2.1 time: 0.331159 Sep 16 08:05:38.640993 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 18/38] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:38 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1235 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:39.235504 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-510aa399-4d57-4740-b53a-e43d30564c31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:39.249283 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-510aa399-4d57-4740-b53a-e43d30564c31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1273 microversion: 2.1 time: 0.751088 Sep 16 08:05:39.249880 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 21/39] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:38 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1273 bytes in 752 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:39.331095 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e56e20dc-bbf6-47a9-a038-cbe10173ab5e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:39.331734 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e56e20dc-bbf6-47a9-a038-cbe10173ab5e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:39.341473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e56e20dc-bbf6-47a9-a038-cbe10173ab5e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:39.342145 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e56e20dc-bbf6-47a9-a038-cbe10173ab5e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:39.343887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e56e20dc-bbf6-47a9-a038-cbe10173ab5e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:39.344789 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e56e20dc-bbf6-47a9-a038-cbe10173ab5e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:39.345766 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e56e20dc-bbf6-47a9-a038-cbe10173ab5e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:39.346553 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e56e20dc-bbf6-47a9-a038-cbe10173ab5e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:39.371340 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a628d033-88a3-497b-9edc-fc1d8fc4ec97 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:39.372007 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a628d033-88a3-497b-9edc-fc1d8fc4ec97 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:39.395236 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a628d033-88a3-497b-9edc-fc1d8fc4ec97 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:39.395757 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a628d033-88a3-497b-9edc-fc1d8fc4ec97 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:39.396217 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a628d033-88a3-497b-9edc-fc1d8fc4ec97 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:39.397473 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a628d033-88a3-497b-9edc-fc1d8fc4ec97 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:39.397978 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a628d033-88a3-497b-9edc-fc1d8fc4ec97 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:39.398416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a628d033-88a3-497b-9edc-fc1d8fc4ec97 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:39.751601 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a628d033-88a3-497b-9edc-fc1d8fc4ec97 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:39.769479 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a628d033-88a3-497b-9edc-fc1d8fc4ec97 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.401804 Sep 16 08:05:39.776247 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 22/40] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:39 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:39.786167 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cb22c8fa-978e-4405-96e0-bfc6936a28ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:39.789104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cb22c8fa-978e-4405-96e0-bfc6936a28ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:39.985745 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cb22c8fa-978e-4405-96e0-bfc6936a28ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:39.994487 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cb22c8fa-978e-4405-96e0-bfc6936a28ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1235 microversion: 2.1 time: 0.216798 Sep 16 08:05:40.049093 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 23/41] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:39 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1235 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:40.089479 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e56e20dc-bbf6-47a9-a038-cbe10173ab5e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:40.101262 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e56e20dc-bbf6-47a9-a038-cbe10173ab5e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1298 microversion: 2.1 time: 0.774128 Sep 16 08:05:40.113000 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 19/42] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:39 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1298 bytes in 787 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:40.269971 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=4 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:40.275033 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-19150260-a05d-4be3-bfcc-160b6940edd7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:40.275692 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-19150260-a05d-4be3-bfcc-160b6940edd7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:40.283288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-19150260-a05d-4be3-bfcc-160b6940edd7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:40.284140 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-19150260-a05d-4be3-bfcc-160b6940edd7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:40.284853 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-19150260-a05d-4be3-bfcc-160b6940edd7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:40.286137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-19150260-a05d-4be3-bfcc-160b6940edd7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:40.287463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-19150260-a05d-4be3-bfcc-160b6940edd7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:40.288334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-19150260-a05d-4be3-bfcc-160b6940edd7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:40.413824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-19150260-a05d-4be3-bfcc-160b6940edd7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:40.437568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-19150260-a05d-4be3-bfcc-160b6940edd7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1291 microversion: 2.1 time: 0.168398 Sep 16 08:05:40.448124 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 24/43] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:40 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1291 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:40.798036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c9a0d6c0-9907-429e-bb7a-a4232b98991d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:40.799487 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c9a0d6c0-9907-429e-bb7a-a4232b98991d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:40.808453 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c9a0d6c0-9907-429e-bb7a-a4232b98991d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:40.809013 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c9a0d6c0-9907-429e-bb7a-a4232b98991d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:40.809463 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c9a0d6c0-9907-429e-bb7a-a4232b98991d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:40.810180 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c9a0d6c0-9907-429e-bb7a-a4232b98991d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:40.810640 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c9a0d6c0-9907-429e-bb7a-a4232b98991d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:40.815148 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c9a0d6c0-9907-429e-bb7a-a4232b98991d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:41.075796 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-08e1360b-c3b3-4c79-b7e9-69f8084a6b7f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:41.076832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-08e1360b-c3b3-4c79-b7e9-69f8084a6b7f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:41.379750 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-08e1360b-c3b3-4c79-b7e9-69f8084a6b7f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:41.389465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-08e1360b-c3b3-4c79-b7e9-69f8084a6b7f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1235 microversion: 2.1 time: 0.325884 Sep 16 08:05:41.390813 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 25/44] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:41 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1235 bytes in 329 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:41.407781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-87256318-d1e0-4fa8-8765-164258d10a4f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:41.411665 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-87256318-d1e0-4fa8-8765-164258d10a4f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:41.434579 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-87256318-d1e0-4fa8-8765-164258d10a4f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:41.436370 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-87256318-d1e0-4fa8-8765-164258d10a4f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:41.437587 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-87256318-d1e0-4fa8-8765-164258d10a4f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:41.438990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-87256318-d1e0-4fa8-8765-164258d10a4f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:41.441274 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-87256318-d1e0-4fa8-8765-164258d10a4f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:41.442049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-87256318-d1e0-4fa8-8765-164258d10a4f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:41.608369 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c9a0d6c0-9907-429e-bb7a-a4232b98991d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:41.617346 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c9a0d6c0-9907-429e-bb7a-a4232b98991d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.823093 Sep 16 08:05:41.627556 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 20/45] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:40 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 834 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:41.659777 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d0c863d4-1520-485f-b2f9-fa3e962ec6cd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:41.669917 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d0c863d4-1520-485f-b2f9-fa3e962ec6cd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:41.688076 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d0c863d4-1520-485f-b2f9-fa3e962ec6cd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:41.689622 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d0c863d4-1520-485f-b2f9-fa3e962ec6cd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:41.690229 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d0c863d4-1520-485f-b2f9-fa3e962ec6cd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:41.690972 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d0c863d4-1520-485f-b2f9-fa3e962ec6cd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:41.691666 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d0c863d4-1520-485f-b2f9-fa3e962ec6cd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:41.692448 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d0c863d4-1520-485f-b2f9-fa3e962ec6cd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:41.890599 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d0c863d4-1520-485f-b2f9-fa3e962ec6cd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:41.901366 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d0c863d4-1520-485f-b2f9-fa3e962ec6cd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1279 microversion: 2.1 time: 0.272632 Sep 16 08:05:41.911291 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 21/46] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:41 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1279 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:42.102882 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-87256318-d1e0-4fa8-8765-164258d10a4f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:42.112340 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-87256318-d1e0-4fa8-8765-164258d10a4f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.718668 Sep 16 08:05:42.115628 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 26/47] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:41 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:42.419666 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a7fdbe19-fdc0-40c4-be10-e24add5f19a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:42.420630 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a7fdbe19-fdc0-40c4-be10-e24add5f19a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:42.432048 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a7fdbe19-fdc0-40c4-be10-e24add5f19a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:42.434723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a7fdbe19-fdc0-40c4-be10-e24add5f19a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:42.434723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a7fdbe19-fdc0-40c4-be10-e24add5f19a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:42.434723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a7fdbe19-fdc0-40c4-be10-e24add5f19a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:42.434723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a7fdbe19-fdc0-40c4-be10-e24add5f19a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:42.439680 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a7fdbe19-fdc0-40c4-be10-e24add5f19a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:42.636086 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a7fdbe19-fdc0-40c4-be10-e24add5f19a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:42.647664 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a7fdbe19-fdc0-40c4-be10-e24add5f19a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1287 microversion: 2.1 time: 0.232735 Sep 16 08:05:42.651414 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 22/48] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:42 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1287 bytes in 237 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:42.655072 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-673b9a65-0f80-464d-a79b-d4c64b1e0491 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:42.655772 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-673b9a65-0f80-464d-a79b-d4c64b1e0491 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:42.695604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-673b9a65-0f80-464d-a79b-d4c64b1e0491 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:42.695604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-673b9a65-0f80-464d-a79b-d4c64b1e0491 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:42.695604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-673b9a65-0f80-464d-a79b-d4c64b1e0491 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:42.695604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-673b9a65-0f80-464d-a79b-d4c64b1e0491 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:42.696687 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-673b9a65-0f80-464d-a79b-d4c64b1e0491 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:42.696687 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-673b9a65-0f80-464d-a79b-d4c64b1e0491 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:42.929261 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-feaba187-aa91-4aed-9385-0d37d65aece5 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:42.930571 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-feaba187-aa91-4aed-9385-0d37d65aece5 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:42.954180 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-feaba187-aa91-4aed-9385-0d37d65aece5 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:42.954887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-feaba187-aa91-4aed-9385-0d37d65aece5 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.015s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:42.961244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-feaba187-aa91-4aed-9385-0d37d65aece5 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:42.961244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-feaba187-aa91-4aed-9385-0d37d65aece5 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:42.961244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-feaba187-aa91-4aed-9385-0d37d65aece5 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:42.963176 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-feaba187-aa91-4aed-9385-0d37d65aece5 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:43.131348 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-673b9a65-0f80-464d-a79b-d4c64b1e0491 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:43.140807 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-673b9a65-0f80-464d-a79b-d4c64b1e0491 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.492450 Sep 16 08:05:43.141963 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 27/49] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:42 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 495 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:43.158727 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b4fd31e6-0d6e-4179-96cb-c746d64143df tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:43.160146 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b4fd31e6-0d6e-4179-96cb-c746d64143df tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:43.176169 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=7 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:43.180379 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b4fd31e6-0d6e-4179-96cb-c746d64143df tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:43.181345 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b4fd31e6-0d6e-4179-96cb-c746d64143df tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:43.182045 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b4fd31e6-0d6e-4179-96cb-c746d64143df tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:43.182980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b4fd31e6-0d6e-4179-96cb-c746d64143df tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:43.183831 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b4fd31e6-0d6e-4179-96cb-c746d64143df tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:43.188419 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b4fd31e6-0d6e-4179-96cb-c746d64143df tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:43.475612 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b4fd31e6-0d6e-4179-96cb-c746d64143df tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:43.484502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b4fd31e6-0d6e-4179-96cb-c746d64143df tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.341346 Sep 16 08:05:43.485252 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 28/50] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:43 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:43.635593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-feaba187-aa91-4aed-9385-0d37d65aece5 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:43.645654 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-feaba187-aa91-4aed-9385-0d37d65aece5 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.719699 Sep 16 08:05:43.649319 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 23/51] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:42 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 725 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:43.678908 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-da29f625-53c8-400f-86ae-91f197176e87 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:43.679912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-da29f625-53c8-400f-86ae-91f197176e87 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:43.689749 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=90,nova_api:INSERT=10 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:43.696638 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-da29f625-53c8-400f-86ae-91f197176e87 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:43.697374 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-da29f625-53c8-400f-86ae-91f197176e87 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:43.697991 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-da29f625-53c8-400f-86ae-91f197176e87 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:43.698912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-da29f625-53c8-400f-86ae-91f197176e87 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:43.699508 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-da29f625-53c8-400f-86ae-91f197176e87 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:43.700079 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-da29f625-53c8-400f-86ae-91f197176e87 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:43.885302 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-910c20c5-02c5-49b6-a64c-b20e47d19b39 req-74d7cc7b-3d3e-4a11-ba20-37874d46b6c6 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "1ddef20f-e546-46b6-9282-f4fb7fc9cb86", "tag": "7ba33ab1-123d-4e11-ba3e-f820f20c39b8"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:05:43.910409 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-910c20c5-02c5-49b6-a64c-b20e47d19b39 req-74d7cc7b-3d3e-4a11-ba20-37874d46b6c6 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:43.911460 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-910c20c5-02c5-49b6-a64c-b20e47d19b39 req-74d7cc7b-3d3e-4a11-ba20-37874d46b6c6 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:43.913266 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-910c20c5-02c5-49b6-a64c-b20e47d19b39 req-74d7cc7b-3d3e-4a11-ba20-37874d46b6c6 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:44.001190 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-910c20c5-02c5-49b6-a64c-b20e47d19b39 req-74d7cc7b-3d3e-4a11-ba20-37874d46b6c6 service nova] Creating event network-changed:7ba33ab1-123d-4e11-ba3e-f820f20c39b8 for instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 on hv-cinder-74014 Sep 16 08:05:44.002847 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-910c20c5-02c5-49b6-a64c-b20e47d19b39 req-74d7cc7b-3d3e-4a11-ba20-37874d46b6c6 service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121046) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 08:05:44.003804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-910c20c5-02c5-49b6-a64c-b20e47d19b39 req-74d7cc7b-3d3e-4a11-ba20-37874d46b6c6 service nova] Acquired lock "compute-rpcapi-router" {{(pid=121046) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 08:05:44.010635 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a4dab0a-5811-4b8d-8921-54b004956229 None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:44.012968 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a4dab0a-5811-4b8d-8921-54b004956229 None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:44.014170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a4dab0a-5811-4b8d-8921-54b004956229 None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:44.018859 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a4dab0a-5811-4b8d-8921-54b004956229 None None] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:44.019356 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a4dab0a-5811-4b8d-8921-54b004956229 None None] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:44.020732 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a4dab0a-5811-4b8d-8921-54b004956229 None None] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:44.044221 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.compute.rpcapi [None req-3a4dab0a-5811-4b8d-8921-54b004956229 None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 16 08:05:44.046100 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a4dab0a-5811-4b8d-8921-54b004956229 None None] Releasing lock "compute-rpcapi-router" {{(pid=121046) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 08:05:44.098672 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3a4dab0a-5811-4b8d-8921-54b004956229 None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.611758 Sep 16 08:05:44.104538 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 29/52] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:05:43 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 619 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:44.250374 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-da29f625-53c8-400f-86ae-91f197176e87 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:44.269636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-da29f625-53c8-400f-86ae-91f197176e87 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1287 microversion: 2.1 time: 0.594951 Sep 16 08:05:44.274758 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 24/53] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:43 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1287 bytes in 602 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:44.308370 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f2db48ad-7aed-4d0a-8277-f337b6bb0fd6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:44.308370 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f2db48ad-7aed-4d0a-8277-f337b6bb0fd6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:44.335812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2db48ad-7aed-4d0a-8277-f337b6bb0fd6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:44.336644 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2db48ad-7aed-4d0a-8277-f337b6bb0fd6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:44.336742 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2db48ad-7aed-4d0a-8277-f337b6bb0fd6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:44.337454 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2db48ad-7aed-4d0a-8277-f337b6bb0fd6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:44.337901 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2db48ad-7aed-4d0a-8277-f337b6bb0fd6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:44.344045 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2db48ad-7aed-4d0a-8277-f337b6bb0fd6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:44.645889 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-03317903-6dc3-457d-9dc8-d15bb1032ea7 req-8eef837c-4977-4cd1-a6f1-f756489a6164 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "c6e123e7-4239-4c3a-8e4b-363f1a2bc058", "tag": "27b13be5-f0af-474b-bcb2-8afc268cf10e"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:05:44.685731 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-03317903-6dc3-457d-9dc8-d15bb1032ea7 req-8eef837c-4977-4cd1-a6f1-f756489a6164 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:44.687612 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-03317903-6dc3-457d-9dc8-d15bb1032ea7 req-8eef837c-4977-4cd1-a6f1-f756489a6164 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:44.691127 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-03317903-6dc3-457d-9dc8-d15bb1032ea7 req-8eef837c-4977-4cd1-a6f1-f756489a6164 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:44.753029 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-03317903-6dc3-457d-9dc8-d15bb1032ea7 req-8eef837c-4977-4cd1-a6f1-f756489a6164 service nova] Creating event network-changed:27b13be5-f0af-474b-bcb2-8afc268cf10e for instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 on hv-cinder-74014 Sep 16 08:05:44.763999 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-03317903-6dc3-457d-9dc8-d15bb1032ea7 req-8eef837c-4977-4cd1-a6f1-f756489a6164 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.657499 Sep 16 08:05:44.765507 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 30/54] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:05:44 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 660 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:44.772346 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-351f503f-c2cb-4008-9d64-9d7ea9f2eda4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:44.773101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-351f503f-c2cb-4008-9d64-9d7ea9f2eda4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:44.780311 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-351f503f-c2cb-4008-9d64-9d7ea9f2eda4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:44.781000 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-351f503f-c2cb-4008-9d64-9d7ea9f2eda4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:44.781592 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-351f503f-c2cb-4008-9d64-9d7ea9f2eda4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:44.782890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-351f503f-c2cb-4008-9d64-9d7ea9f2eda4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:44.783698 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-351f503f-c2cb-4008-9d64-9d7ea9f2eda4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:44.784449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-351f503f-c2cb-4008-9d64-9d7ea9f2eda4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:45.089486 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-351f503f-c2cb-4008-9d64-9d7ea9f2eda4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:45.098122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:45.101010 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-351f503f-c2cb-4008-9d64-9d7ea9f2eda4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.334020 Sep 16 08:05:45.103304 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 31/55] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:44 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 337 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:45.111310 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-769900d1-1d35-428b-a34e-ada62042a6a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:45.112391 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-769900d1-1d35-428b-a34e-ada62042a6a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:45.119570 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-769900d1-1d35-428b-a34e-ada62042a6a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:45.120343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-769900d1-1d35-428b-a34e-ada62042a6a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:45.121181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-769900d1-1d35-428b-a34e-ada62042a6a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:45.122200 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-769900d1-1d35-428b-a34e-ada62042a6a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:45.122948 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-769900d1-1d35-428b-a34e-ada62042a6a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:45.123531 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-769900d1-1d35-428b-a34e-ada62042a6a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:45.419602 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-769900d1-1d35-428b-a34e-ada62042a6a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:45.429097 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-769900d1-1d35-428b-a34e-ada62042a6a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.324451 Sep 16 08:05:45.431001 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 32/56] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:45 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:45.436380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-faba229b-1749-4339-ab6b-23b296792e81 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:45.437108 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-faba229b-1749-4339-ab6b-23b296792e81 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:45.443557 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-faba229b-1749-4339-ab6b-23b296792e81 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:45.444066 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-faba229b-1749-4339-ab6b-23b296792e81 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:45.449610 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-faba229b-1749-4339-ab6b-23b296792e81 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:45.457588 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-faba229b-1749-4339-ab6b-23b296792e81 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:45.459918 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-faba229b-1749-4339-ab6b-23b296792e81 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:45.462117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-faba229b-1749-4339-ab6b-23b296792e81 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:45.726921 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-faba229b-1749-4339-ab6b-23b296792e81 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:45.736033 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f2db48ad-7aed-4d0a-8277-f337b6bb0fd6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:45.737574 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-faba229b-1749-4339-ab6b-23b296792e81 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1293 microversion: 2.1 time: 0.303552 Sep 16 08:05:45.759472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 33/57] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:45 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1293 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:45.768562 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f2db48ad-7aed-4d0a-8277-f337b6bb0fd6 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 1.485351 Sep 16 08:05:45.768562 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 25/58] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:44 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 1490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:46.130048 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ab0017b0-8caf-4cc9-b4ad-c5f0ea75cfb4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:46.130735 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ab0017b0-8caf-4cc9-b4ad-c5f0ea75cfb4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:46.145045 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab0017b0-8caf-4cc9-b4ad-c5f0ea75cfb4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:46.145045 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab0017b0-8caf-4cc9-b4ad-c5f0ea75cfb4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:46.145045 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab0017b0-8caf-4cc9-b4ad-c5f0ea75cfb4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:46.145045 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab0017b0-8caf-4cc9-b4ad-c5f0ea75cfb4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:46.151222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab0017b0-8caf-4cc9-b4ad-c5f0ea75cfb4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:46.151688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab0017b0-8caf-4cc9-b4ad-c5f0ea75cfb4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:46.456801 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2f464374-77a2-4263-b7d2-74ac8438b891 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:46.457685 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2f464374-77a2-4263-b7d2-74ac8438b891 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:46.471851 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2f464374-77a2-4263-b7d2-74ac8438b891 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:46.472391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2f464374-77a2-4263-b7d2-74ac8438b891 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:46.472841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2f464374-77a2-4263-b7d2-74ac8438b891 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:46.473593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2f464374-77a2-4263-b7d2-74ac8438b891 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:46.479358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2f464374-77a2-4263-b7d2-74ac8438b891 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:46.480029 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2f464374-77a2-4263-b7d2-74ac8438b891 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:46.507798 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ab0017b0-8caf-4cc9-b4ad-c5f0ea75cfb4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:46.529330 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ab0017b0-8caf-4cc9-b4ad-c5f0ea75cfb4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.404284 Sep 16 08:05:46.530188 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 34/59] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:46 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:46.766930 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-96569e72-883c-429b-b3ac-a7da41875585 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:46.767546 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-96569e72-883c-429b-b3ac-a7da41875585 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:46.774721 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-96569e72-883c-429b-b3ac-a7da41875585 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:46.775219 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-96569e72-883c-429b-b3ac-a7da41875585 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:46.775657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-96569e72-883c-429b-b3ac-a7da41875585 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:46.776392 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-96569e72-883c-429b-b3ac-a7da41875585 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:46.776822 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-96569e72-883c-429b-b3ac-a7da41875585 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:46.777261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-96569e72-883c-429b-b3ac-a7da41875585 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:46.874648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-96569e72-883c-429b-b3ac-a7da41875585 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:46.916072 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-96569e72-883c-429b-b3ac-a7da41875585 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1293 microversion: 2.1 time: 0.152835 Sep 16 08:05:46.916961 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 35/60] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:46 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1293 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:46.932474 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-70d5e9ef-525a-4916-91ff-04a232853a3e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:46.932474 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-70d5e9ef-525a-4916-91ff-04a232853a3e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:46.947784 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-70d5e9ef-525a-4916-91ff-04a232853a3e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:46.948287 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-70d5e9ef-525a-4916-91ff-04a232853a3e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:46.948735 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-70d5e9ef-525a-4916-91ff-04a232853a3e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:46.949448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-70d5e9ef-525a-4916-91ff-04a232853a3e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:46.949911 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-70d5e9ef-525a-4916-91ff-04a232853a3e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:46.950340 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-70d5e9ef-525a-4916-91ff-04a232853a3e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:47.269408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-70d5e9ef-525a-4916-91ff-04a232853a3e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:47.281350 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-70d5e9ef-525a-4916-91ff-04a232853a3e tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.358192 Sep 16 08:05:47.283345 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 36/61] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:46 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 365 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:47.301668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-932ec7e2-c1e0-44ad-b0ef-4ebed723aea6 req-8fb31d91-8cde-4a46-ab10-ab7fced4317e service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547e4d8b-02bd-4033-82b3-04db0ba60fe5", "tag": "047136d4-f91b-4e74-bfe8-7505cf1c706e"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:05:47.336064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-932ec7e2-c1e0-44ad-b0ef-4ebed723aea6 req-8fb31d91-8cde-4a46-ab10-ab7fced4317e service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:47.336626 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-932ec7e2-c1e0-44ad-b0ef-4ebed723aea6 req-8fb31d91-8cde-4a46-ab10-ab7fced4317e service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:47.337262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-932ec7e2-c1e0-44ad-b0ef-4ebed723aea6 req-8fb31d91-8cde-4a46-ab10-ab7fced4317e service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:47.354536 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-932ec7e2-c1e0-44ad-b0ef-4ebed723aea6 req-8fb31d91-8cde-4a46-ab10-ab7fced4317e service nova] Creating event network-changed:047136d4-f91b-4e74-bfe8-7505cf1c706e for instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 on hv-cinder-74014 Sep 16 08:05:47.366800 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-932ec7e2-c1e0-44ad-b0ef-4ebed723aea6 req-8fb31d91-8cde-4a46-ab10-ab7fced4317e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.079281 Sep 16 08:05:47.371087 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 37/62] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:05:47 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:47.394358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=6 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:47.555770 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2f464374-77a2-4263-b7d2-74ac8438b891 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:47.559423 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-58ed5242-f1bf-4e85-84b6-5777d551b66b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:47.560206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-58ed5242-f1bf-4e85-84b6-5777d551b66b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:47.572636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58ed5242-f1bf-4e85-84b6-5777d551b66b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:47.573655 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58ed5242-f1bf-4e85-84b6-5777d551b66b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:47.574254 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58ed5242-f1bf-4e85-84b6-5777d551b66b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:47.580541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58ed5242-f1bf-4e85-84b6-5777d551b66b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:47.580541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58ed5242-f1bf-4e85-84b6-5777d551b66b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:47.580541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58ed5242-f1bf-4e85-84b6-5777d551b66b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:47.585081 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2f464374-77a2-4263-b7d2-74ac8438b891 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 1.129960 Sep 16 08:05:47.588303 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 26/63] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:46 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 1136 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:47.944316 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-cc641ffa-833f-485f-9be5-924752613c9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:47.945301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-cc641ffa-833f-485f-9be5-924752613c9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:47.959336 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cc641ffa-833f-485f-9be5-924752613c9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:47.959760 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cc641ffa-833f-485f-9be5-924752613c9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:47.960206 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cc641ffa-833f-485f-9be5-924752613c9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:47.960923 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cc641ffa-833f-485f-9be5-924752613c9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:47.961380 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cc641ffa-833f-485f-9be5-924752613c9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:47.961806 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cc641ffa-833f-485f-9be5-924752613c9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:48.073347 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-58ed5242-f1bf-4e85-84b6-5777d551b66b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:48.089140 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-58ed5242-f1bf-4e85-84b6-5777d551b66b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.534003 Sep 16 08:05:48.092484 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 38/64] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:47 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 538 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:48.122581 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cc641ffa-833f-485f-9be5-924752613c9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:48.141161 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-cc641ffa-833f-485f-9be5-924752613c9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1293 microversion: 2.1 time: 0.204841 Sep 16 08:05:48.143057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 27/65] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:47 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1293 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:48.310243 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-43626f8b-bd96-464f-890c-03be94594940 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:48.311616 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-43626f8b-bd96-464f-890c-03be94594940 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:48.317907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-43626f8b-bd96-464f-890c-03be94594940 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:48.318633 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-43626f8b-bd96-464f-890c-03be94594940 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:48.319003 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-43626f8b-bd96-464f-890c-03be94594940 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:48.319879 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-43626f8b-bd96-464f-890c-03be94594940 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:48.320335 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-43626f8b-bd96-464f-890c-03be94594940 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:48.320759 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-43626f8b-bd96-464f-890c-03be94594940 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:48.611845 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f3b61276-51d6-4017-9a58-a3fd526b09a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:48.613133 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f3b61276-51d6-4017-9a58-a3fd526b09a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:48.624461 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f3b61276-51d6-4017-9a58-a3fd526b09a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:48.626616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f3b61276-51d6-4017-9a58-a3fd526b09a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:48.627819 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f3b61276-51d6-4017-9a58-a3fd526b09a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:48.629893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f3b61276-51d6-4017-9a58-a3fd526b09a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:48.632211 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f3b61276-51d6-4017-9a58-a3fd526b09a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:48.632887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f3b61276-51d6-4017-9a58-a3fd526b09a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:48.643872 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=32 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:48.706404 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-43626f8b-bd96-464f-890c-03be94594940 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:48.722948 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-43626f8b-bd96-464f-890c-03be94594940 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.413780 Sep 16 08:05:48.724393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 39/66] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:48 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 420 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:49.124524 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-565e6455-dc23-4065-97f6-09cab95be6ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:49.126381 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-565e6455-dc23-4065-97f6-09cab95be6ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:49.143500 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-565e6455-dc23-4065-97f6-09cab95be6ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:49.144399 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-565e6455-dc23-4065-97f6-09cab95be6ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:49.145073 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-565e6455-dc23-4065-97f6-09cab95be6ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:49.146563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-565e6455-dc23-4065-97f6-09cab95be6ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:49.149623 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-565e6455-dc23-4065-97f6-09cab95be6ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:49.150322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-565e6455-dc23-4065-97f6-09cab95be6ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:49.302393 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f3b61276-51d6-4017-9a58-a3fd526b09a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:49.319916 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f3b61276-51d6-4017-9a58-a3fd526b09a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.712154 Sep 16 08:05:49.329563 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 28/67] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:48 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 722 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:49.345716 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-df85ce8d-7aa6-44be-8379-b08dff07e2f7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:49.346856 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-df85ce8d-7aa6-44be-8379-b08dff07e2f7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:49.365088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-df85ce8d-7aa6-44be-8379-b08dff07e2f7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:49.368955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-df85ce8d-7aa6-44be-8379-b08dff07e2f7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:49.369577 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-df85ce8d-7aa6-44be-8379-b08dff07e2f7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:49.370918 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-df85ce8d-7aa6-44be-8379-b08dff07e2f7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:49.374737 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-df85ce8d-7aa6-44be-8379-b08dff07e2f7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:49.382375 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-df85ce8d-7aa6-44be-8379-b08dff07e2f7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:49.585831 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-565e6455-dc23-4065-97f6-09cab95be6ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:49.600720 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-565e6455-dc23-4065-97f6-09cab95be6ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.483973 Sep 16 08:05:49.604246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 40/68] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:49 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 490 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:49.609946 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-7375c142-1881-4308-b73f-7ceeac1687bd req-61b67416-af57-4d4c-88b2-56a821976bc3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "d6ed2e44-f810-44fb-96f8-50847e08026e", "tag": "c9911fe4-6d13-4e4b-9a6e-7699e12bfdc4"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:05:49.664017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-7375c142-1881-4308-b73f-7ceeac1687bd req-61b67416-af57-4d4c-88b2-56a821976bc3 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:49.664778 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-7375c142-1881-4308-b73f-7ceeac1687bd req-61b67416-af57-4d4c-88b2-56a821976bc3 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:49.665546 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-7375c142-1881-4308-b73f-7ceeac1687bd req-61b67416-af57-4d4c-88b2-56a821976bc3 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:49.688421 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-7375c142-1881-4308-b73f-7ceeac1687bd req-61b67416-af57-4d4c-88b2-56a821976bc3 service nova] Creating event network-changed:c9911fe4-6d13-4e4b-9a6e-7699e12bfdc4 for instance d6ed2e44-f810-44fb-96f8-50847e08026e on hv-cinder-74014 Sep 16 08:05:49.706373 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-7375c142-1881-4308-b73f-7ceeac1687bd req-61b67416-af57-4d4c-88b2-56a821976bc3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.099937 Sep 16 08:05:49.707636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 41/69] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:05:49 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:49.746427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8ad18d14-61e9-4471-b85a-53928a45897a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:49.747207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8ad18d14-61e9-4471-b85a-53928a45897a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:49.764521 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ad18d14-61e9-4471-b85a-53928a45897a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:49.765097 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ad18d14-61e9-4471-b85a-53928a45897a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:49.765601 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ad18d14-61e9-4471-b85a-53928a45897a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:49.766394 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ad18d14-61e9-4471-b85a-53928a45897a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:49.766888 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ad18d14-61e9-4471-b85a-53928a45897a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:49.767361 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ad18d14-61e9-4471-b85a-53928a45897a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:50.231810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-df85ce8d-7aa6-44be-8379-b08dff07e2f7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:50.249164 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-df85ce8d-7aa6-44be-8379-b08dff07e2f7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.917723 Sep 16 08:05:50.254668 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 29/70] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:49 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 923 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:50.324753 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8ad18d14-61e9-4471-b85a-53928a45897a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:50.352569 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7d16fb18-dd17-479c-9798-b4e30a63e0a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:50.352569 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7d16fb18-dd17-479c-9798-b4e30a63e0a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:50.362613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8ad18d14-61e9-4471-b85a-53928a45897a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.598338 Sep 16 08:05:50.369022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 42/71] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:49 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 628 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:50.376710 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7d16fb18-dd17-479c-9798-b4e30a63e0a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:50.387810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7d16fb18-dd17-479c-9798-b4e30a63e0a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:50.387810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7d16fb18-dd17-479c-9798-b4e30a63e0a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:50.387810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7d16fb18-dd17-479c-9798-b4e30a63e0a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:50.387810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7d16fb18-dd17-479c-9798-b4e30a63e0a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:50.388460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7d16fb18-dd17-479c-9798-b4e30a63e0a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:50.594907 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7d16fb18-dd17-479c-9798-b4e30a63e0a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:50.603244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7d16fb18-dd17-479c-9798-b4e30a63e0a7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.260343 Sep 16 08:05:50.603909 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 30/72] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:50 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:50.629822 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-32270f00-4ce9-45cf-b942-5052e951fb4a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:50.631124 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-32270f00-4ce9-45cf-b942-5052e951fb4a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:50.639245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32270f00-4ce9-45cf-b942-5052e951fb4a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:50.640165 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32270f00-4ce9-45cf-b942-5052e951fb4a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:50.640780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32270f00-4ce9-45cf-b942-5052e951fb4a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:50.641800 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32270f00-4ce9-45cf-b942-5052e951fb4a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:50.642416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32270f00-4ce9-45cf-b942-5052e951fb4a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:50.643185 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32270f00-4ce9-45cf-b942-5052e951fb4a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:50.840944 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-32270f00-4ce9-45cf-b942-5052e951fb4a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:50.850033 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-32270f00-4ce9-45cf-b942-5052e951fb4a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.224674 Sep 16 08:05:50.872014 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 43/73] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:50 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:51.277534 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-dfeeda4f-31d4-47a9-b49a-18d75acbdbcb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:51.284155 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-dfeeda4f-31d4-47a9-b49a-18d75acbdbcb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:51.291071 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dfeeda4f-31d4-47a9-b49a-18d75acbdbcb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:51.291756 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dfeeda4f-31d4-47a9-b49a-18d75acbdbcb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:51.297661 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dfeeda4f-31d4-47a9-b49a-18d75acbdbcb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:51.297661 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dfeeda4f-31d4-47a9-b49a-18d75acbdbcb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:51.297661 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dfeeda4f-31d4-47a9-b49a-18d75acbdbcb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:51.297661 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dfeeda4f-31d4-47a9-b49a-18d75acbdbcb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:51.312010 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=100 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:51.393162 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-bd3e3a77-5956-42af-a60c-239a510f9cd2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:51.394974 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-bd3e3a77-5956-42af-a60c-239a510f9cd2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:51.401656 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=28 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:51.406163 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bd3e3a77-5956-42af-a60c-239a510f9cd2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:51.407333 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bd3e3a77-5956-42af-a60c-239a510f9cd2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:51.412251 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bd3e3a77-5956-42af-a60c-239a510f9cd2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:51.412251 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bd3e3a77-5956-42af-a60c-239a510f9cd2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:51.412251 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bd3e3a77-5956-42af-a60c-239a510f9cd2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:51.412251 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bd3e3a77-5956-42af-a60c-239a510f9cd2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:51.482621 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dfeeda4f-31d4-47a9-b49a-18d75acbdbcb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:51.496219 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-dfeeda4f-31d4-47a9-b49a-18d75acbdbcb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.222408 Sep 16 08:05:51.499253 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 31/74] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:51 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 226 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:51.595842 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-bd3e3a77-5956-42af-a60c-239a510f9cd2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:51.605370 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-bd3e3a77-5956-42af-a60c-239a510f9cd2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.217167 Sep 16 08:05:51.606883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 44/75] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:51 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:51.627598 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-21106df9-9750-4d86-a000-441f4fd5e382 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:51.628211 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-21106df9-9750-4d86-a000-441f4fd5e382 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:51.634379 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-21106df9-9750-4d86-a000-441f4fd5e382 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:51.634841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-21106df9-9750-4d86-a000-441f4fd5e382 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:51.635449 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-21106df9-9750-4d86-a000-441f4fd5e382 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:51.636163 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-21106df9-9750-4d86-a000-441f4fd5e382 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:51.636789 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-21106df9-9750-4d86-a000-441f4fd5e382 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:51.637041 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-21106df9-9750-4d86-a000-441f4fd5e382 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:51.750147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-472f0b63-6ac0-4b4b-892f-26cd6a495a2d req-9f8a49b5-f8c6-4bea-9538-38372b6e64e3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe69a551-c89a-4b4f-a026-5e23f39a1355", "tag": "8a64e1a8-08fe-42cc-84de-a5e3362d89fc"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:05:51.759600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-472f0b63-6ac0-4b4b-892f-26cd6a495a2d req-9f8a49b5-f8c6-4bea-9538-38372b6e64e3 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:51.759600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-472f0b63-6ac0-4b4b-892f-26cd6a495a2d req-9f8a49b5-f8c6-4bea-9538-38372b6e64e3 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:51.759600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-472f0b63-6ac0-4b4b-892f-26cd6a495a2d req-9f8a49b5-f8c6-4bea-9538-38372b6e64e3 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:51.773421 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-472f0b63-6ac0-4b4b-892f-26cd6a495a2d req-9f8a49b5-f8c6-4bea-9538-38372b6e64e3 service nova] Creating event network-changed:8a64e1a8-08fe-42cc-84de-a5e3362d89fc for instance fe69a551-c89a-4b4f-a026-5e23f39a1355 on hv-cinder-74014 Sep 16 08:05:51.781637 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-472f0b63-6ac0-4b4b-892f-26cd6a495a2d req-9f8a49b5-f8c6-4bea-9538-38372b6e64e3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044544 Sep 16 08:05:51.783506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 45/76] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:05:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:05:51.853715 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-21106df9-9750-4d86-a000-441f4fd5e382 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:51.860886 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-21106df9-9750-4d86-a000-441f4fd5e382 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.237434 Sep 16 08:05:51.861513 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 32/77] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:51 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:51.874932 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ced5b02a-dbe1-4c33-93eb-03dfee0eb01a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:51.875764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ced5b02a-dbe1-4c33-93eb-03dfee0eb01a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:51.882154 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ced5b02a-dbe1-4c33-93eb-03dfee0eb01a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:51.882725 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ced5b02a-dbe1-4c33-93eb-03dfee0eb01a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:51.883227 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ced5b02a-dbe1-4c33-93eb-03dfee0eb01a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:51.883914 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ced5b02a-dbe1-4c33-93eb-03dfee0eb01a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:51.884361 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ced5b02a-dbe1-4c33-93eb-03dfee0eb01a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:51.884825 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ced5b02a-dbe1-4c33-93eb-03dfee0eb01a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:52.032322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ced5b02a-dbe1-4c33-93eb-03dfee0eb01a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:52.044605 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ced5b02a-dbe1-4c33-93eb-03dfee0eb01a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.173692 Sep 16 08:05:52.060160 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 46/78] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:51 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:52.526503 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f3caca73-3fa9-441a-89c4-8400becc8d6a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:52.526960 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f3caca73-3fa9-441a-89c4-8400becc8d6a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:52.532929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f3caca73-3fa9-441a-89c4-8400becc8d6a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:52.533422 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f3caca73-3fa9-441a-89c4-8400becc8d6a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:52.533870 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f3caca73-3fa9-441a-89c4-8400becc8d6a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:52.534568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f3caca73-3fa9-441a-89c4-8400becc8d6a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:52.535056 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f3caca73-3fa9-441a-89c4-8400becc8d6a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:52.535741 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f3caca73-3fa9-441a-89c4-8400becc8d6a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:52.628268 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-043bba27-c0ea-4115-88d0-8fc418d46ed9 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:52.628977 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-043bba27-c0ea-4115-88d0-8fc418d46ed9 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:52.649098 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-043bba27-c0ea-4115-88d0-8fc418d46ed9 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:52.649098 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-043bba27-c0ea-4115-88d0-8fc418d46ed9 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:52.649098 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-043bba27-c0ea-4115-88d0-8fc418d46ed9 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:52.649098 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-043bba27-c0ea-4115-88d0-8fc418d46ed9 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:52.649547 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-043bba27-c0ea-4115-88d0-8fc418d46ed9 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:52.650071 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-043bba27-c0ea-4115-88d0-8fc418d46ed9 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:52.681162 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f3caca73-3fa9-441a-89c4-8400becc8d6a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:52.688038 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f3caca73-3fa9-441a-89c4-8400becc8d6a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.166367 Sep 16 08:05:52.688600 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 33/79] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:52 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:52.785754 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-043bba27-c0ea-4115-88d0-8fc418d46ed9 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:52.793895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-043bba27-c0ea-4115-88d0-8fc418d46ed9 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.170116 Sep 16 08:05:52.794449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 47/80] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:52 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:52.884147 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d8bf87f0-e23e-4c4f-b9c2-84753e1e0a5b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:52.884833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d8bf87f0-e23e-4c4f-b9c2-84753e1e0a5b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:52.891274 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8bf87f0-e23e-4c4f-b9c2-84753e1e0a5b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:52.892067 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8bf87f0-e23e-4c4f-b9c2-84753e1e0a5b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:52.892930 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8bf87f0-e23e-4c4f-b9c2-84753e1e0a5b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:52.894043 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8bf87f0-e23e-4c4f-b9c2-84753e1e0a5b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:52.894850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8bf87f0-e23e-4c4f-b9c2-84753e1e0a5b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:52.895337 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8bf87f0-e23e-4c4f-b9c2-84753e1e0a5b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:53.070187 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5dc5b32d-3b59-4440-811b-31dc4e710932 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:53.074161 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d8bf87f0-e23e-4c4f-b9c2-84753e1e0a5b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:53.078100 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5dc5b32d-3b59-4440-811b-31dc4e710932 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:53.082725 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d8bf87f0-e23e-4c4f-b9c2-84753e1e0a5b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.202399 Sep 16 08:05:53.087758 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 34/81] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:52 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:53.103390 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5dc5b32d-3b59-4440-811b-31dc4e710932 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:53.116667 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5dc5b32d-3b59-4440-811b-31dc4e710932 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:53.117268 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5dc5b32d-3b59-4440-811b-31dc4e710932 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:53.118047 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5dc5b32d-3b59-4440-811b-31dc4e710932 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:53.118752 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5dc5b32d-3b59-4440-811b-31dc4e710932 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:53.118996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5dc5b32d-3b59-4440-811b-31dc4e710932 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:53.335511 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5dc5b32d-3b59-4440-811b-31dc4e710932 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:53.344979 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5dc5b32d-3b59-4440-811b-31dc4e710932 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.280712 Sep 16 08:05:53.345868 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 48/82] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:53 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:53.710364 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-dbfbb7ce-6f31-4010-b5b8-c55ae563a0e4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:53.710954 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-dbfbb7ce-6f31-4010-b5b8-c55ae563a0e4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:53.716869 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dbfbb7ce-6f31-4010-b5b8-c55ae563a0e4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:53.717411 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dbfbb7ce-6f31-4010-b5b8-c55ae563a0e4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:53.717874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dbfbb7ce-6f31-4010-b5b8-c55ae563a0e4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:53.718552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dbfbb7ce-6f31-4010-b5b8-c55ae563a0e4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:53.719044 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dbfbb7ce-6f31-4010-b5b8-c55ae563a0e4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:53.719476 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dbfbb7ce-6f31-4010-b5b8-c55ae563a0e4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:53.817321 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4da92c8e-f6c7-41cd-964e-f296486eb7eb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:53.817972 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4da92c8e-f6c7-41cd-964e-f296486eb7eb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:53.824145 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4da92c8e-f6c7-41cd-964e-f296486eb7eb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:53.824813 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4da92c8e-f6c7-41cd-964e-f296486eb7eb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:53.825409 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4da92c8e-f6c7-41cd-964e-f296486eb7eb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:53.826104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4da92c8e-f6c7-41cd-964e-f296486eb7eb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:53.826760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4da92c8e-f6c7-41cd-964e-f296486eb7eb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:53.827187 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4da92c8e-f6c7-41cd-964e-f296486eb7eb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:53.851794 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dbfbb7ce-6f31-4010-b5b8-c55ae563a0e4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:53.859869 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-dbfbb7ce-6f31-4010-b5b8-c55ae563a0e4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.153862 Sep 16 08:05:53.860739 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 35/83] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:53 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:53.981907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4da92c8e-f6c7-41cd-964e-f296486eb7eb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:53.991546 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4da92c8e-f6c7-41cd-964e-f296486eb7eb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.178005 Sep 16 08:05:53.992132 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 49/84] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:53 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:54.109328 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-645d402f-f054-4a44-ac62-3a72cd64b795 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:54.109932 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-645d402f-f054-4a44-ac62-3a72cd64b795 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:54.116043 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-645d402f-f054-4a44-ac62-3a72cd64b795 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:54.116396 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-645d402f-f054-4a44-ac62-3a72cd64b795 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:54.116839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-645d402f-f054-4a44-ac62-3a72cd64b795 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:54.117529 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-645d402f-f054-4a44-ac62-3a72cd64b795 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:54.117986 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-645d402f-f054-4a44-ac62-3a72cd64b795 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:54.118413 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-645d402f-f054-4a44-ac62-3a72cd64b795 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:54.265337 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-645d402f-f054-4a44-ac62-3a72cd64b795 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:54.274069 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-645d402f-f054-4a44-ac62-3a72cd64b795 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.168589 Sep 16 08:05:54.274650 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 36/85] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:54 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:54.367317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:54.371215 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2010e7ed-3b9d-419b-8813-ba4a1db271a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:54.373274 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2010e7ed-3b9d-419b-8813-ba4a1db271a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:54.384737 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2010e7ed-3b9d-419b-8813-ba4a1db271a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:54.385227 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2010e7ed-3b9d-419b-8813-ba4a1db271a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:54.385668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2010e7ed-3b9d-419b-8813-ba4a1db271a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:54.386779 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2010e7ed-3b9d-419b-8813-ba4a1db271a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:54.387170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2010e7ed-3b9d-419b-8813-ba4a1db271a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:54.387754 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2010e7ed-3b9d-419b-8813-ba4a1db271a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:54.408292 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:05:54.564865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2010e7ed-3b9d-419b-8813-ba4a1db271a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:54.573161 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2010e7ed-3b9d-419b-8813-ba4a1db271a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.209274 Sep 16 08:05:54.573920 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 50/86] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:54 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:54.883876 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ab2fb058-1bb8-4a48-8413-197aa77569b9 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:54.884487 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ab2fb058-1bb8-4a48-8413-197aa77569b9 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:54.890499 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ab2fb058-1bb8-4a48-8413-197aa77569b9 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:54.891021 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ab2fb058-1bb8-4a48-8413-197aa77569b9 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:54.891463 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ab2fb058-1bb8-4a48-8413-197aa77569b9 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:54.892156 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ab2fb058-1bb8-4a48-8413-197aa77569b9 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:54.892609 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ab2fb058-1bb8-4a48-8413-197aa77569b9 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:54.893036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ab2fb058-1bb8-4a48-8413-197aa77569b9 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:55.016067 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d8c1da22-0135-4535-b0bb-ca0bd32ab8a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:55.017764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d8c1da22-0135-4535-b0bb-ca0bd32ab8a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:55.030735 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d8c1da22-0135-4535-b0bb-ca0bd32ab8a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:55.030735 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d8c1da22-0135-4535-b0bb-ca0bd32ab8a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:55.031918 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d8c1da22-0135-4535-b0bb-ca0bd32ab8a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:55.032918 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d8c1da22-0135-4535-b0bb-ca0bd32ab8a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:55.034404 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d8c1da22-0135-4535-b0bb-ca0bd32ab8a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:55.035504 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d8c1da22-0135-4535-b0bb-ca0bd32ab8a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:55.057395 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ab2fb058-1bb8-4a48-8413-197aa77569b9 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:55.065301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ab2fb058-1bb8-4a48-8413-197aa77569b9 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.185332 Sep 16 08:05:55.065995 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 37/87] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:54 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:55.181591 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d8c1da22-0135-4535-b0bb-ca0bd32ab8a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:55.191875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d8c1da22-0135-4535-b0bb-ca0bd32ab8a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.178452 Sep 16 08:05:55.191875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 51/88] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:55 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:55.301352 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9179a2f9-a685-42ef-85fc-446a90e1cbca tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:55.301963 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9179a2f9-a685-42ef-85fc-446a90e1cbca tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:55.308848 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9179a2f9-a685-42ef-85fc-446a90e1cbca tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:55.309553 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9179a2f9-a685-42ef-85fc-446a90e1cbca tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:55.310157 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9179a2f9-a685-42ef-85fc-446a90e1cbca tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:55.311056 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9179a2f9-a685-42ef-85fc-446a90e1cbca tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:55.311519 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9179a2f9-a685-42ef-85fc-446a90e1cbca tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:55.312272 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9179a2f9-a685-42ef-85fc-446a90e1cbca tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:55.458169 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9179a2f9-a685-42ef-85fc-446a90e1cbca tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:55.466725 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9179a2f9-a685-42ef-85fc-446a90e1cbca tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.169337 Sep 16 08:05:55.467295 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 38/89] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:55 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:55.606002 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e3498c98-c9f4-486f-b63a-509aa9d33ba1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:55.606622 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e3498c98-c9f4-486f-b63a-509aa9d33ba1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:55.613985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e3498c98-c9f4-486f-b63a-509aa9d33ba1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:55.615129 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e3498c98-c9f4-486f-b63a-509aa9d33ba1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:55.615870 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e3498c98-c9f4-486f-b63a-509aa9d33ba1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:55.616865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e3498c98-c9f4-486f-b63a-509aa9d33ba1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:55.617745 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e3498c98-c9f4-486f-b63a-509aa9d33ba1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:55.618563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e3498c98-c9f4-486f-b63a-509aa9d33ba1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:55.767336 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e3498c98-c9f4-486f-b63a-509aa9d33ba1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:55.775869 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e3498c98-c9f4-486f-b63a-509aa9d33ba1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.175533 Sep 16 08:05:55.776516 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 52/90] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:55 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:56.088541 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2c54c317-934e-4ac4-9fda-c8b873aba860 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:56.089343 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2c54c317-934e-4ac4-9fda-c8b873aba860 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:56.095372 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2c54c317-934e-4ac4-9fda-c8b873aba860 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:56.095860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2c54c317-934e-4ac4-9fda-c8b873aba860 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:56.096296 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2c54c317-934e-4ac4-9fda-c8b873aba860 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:56.096983 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2c54c317-934e-4ac4-9fda-c8b873aba860 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:56.097438 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2c54c317-934e-4ac4-9fda-c8b873aba860 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:56.098151 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2c54c317-934e-4ac4-9fda-c8b873aba860 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:56.213346 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-03a0febe-0e16-4e2d-8c95-ad1176f14443 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:56.214635 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-03a0febe-0e16-4e2d-8c95-ad1176f14443 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:56.221469 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-03a0febe-0e16-4e2d-8c95-ad1176f14443 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:56.222152 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-03a0febe-0e16-4e2d-8c95-ad1176f14443 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:56.222756 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-03a0febe-0e16-4e2d-8c95-ad1176f14443 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:56.224891 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-03a0febe-0e16-4e2d-8c95-ad1176f14443 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:56.225518 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-03a0febe-0e16-4e2d-8c95-ad1176f14443 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:56.226112 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-03a0febe-0e16-4e2d-8c95-ad1176f14443 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:56.254325 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2c54c317-934e-4ac4-9fda-c8b873aba860 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:56.264317 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2c54c317-934e-4ac4-9fda-c8b873aba860 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.179669 Sep 16 08:05:56.266240 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 39/91] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:56 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:56.429457 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-03a0febe-0e16-4e2d-8c95-ad1176f14443 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:56.440543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-03a0febe-0e16-4e2d-8c95-ad1176f14443 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.231735 Sep 16 08:05:56.454703 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 53/92] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:56 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:56.494500 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-40b0faf0-2b3b-4d53-a9fa-78667af5113f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:56.495559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-40b0faf0-2b3b-4d53-a9fa-78667af5113f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:56.503072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-40b0faf0-2b3b-4d53-a9fa-78667af5113f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:56.503815 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-40b0faf0-2b3b-4d53-a9fa-78667af5113f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:56.506058 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-40b0faf0-2b3b-4d53-a9fa-78667af5113f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:56.510423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-40b0faf0-2b3b-4d53-a9fa-78667af5113f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:56.510423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-40b0faf0-2b3b-4d53-a9fa-78667af5113f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:56.510423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-40b0faf0-2b3b-4d53-a9fa-78667af5113f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:56.745527 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-40b0faf0-2b3b-4d53-a9fa-78667af5113f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:56.755621 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-40b0faf0-2b3b-4d53-a9fa-78667af5113f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.269765 Sep 16 08:05:56.761434 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 40/93] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:56 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 273 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:56.798708 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3b0acc9c-8d42-48bd-b957-b41a17818919 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:56.799333 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3b0acc9c-8d42-48bd-b957-b41a17818919 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:56.805606 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3b0acc9c-8d42-48bd-b957-b41a17818919 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:56.806081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3b0acc9c-8d42-48bd-b957-b41a17818919 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:56.806514 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3b0acc9c-8d42-48bd-b957-b41a17818919 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:56.807395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3b0acc9c-8d42-48bd-b957-b41a17818919 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:56.807845 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3b0acc9c-8d42-48bd-b957-b41a17818919 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:56.808344 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3b0acc9c-8d42-48bd-b957-b41a17818919 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:56.961254 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3b0acc9c-8d42-48bd-b957-b41a17818919 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:56.978220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3b0acc9c-8d42-48bd-b957-b41a17818919 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.183236 Sep 16 08:05:56.994798 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 54/94] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:56 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:57.287900 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-774d314b-143c-417d-8ef8-ff2380f6bdaa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:57.289074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-774d314b-143c-417d-8ef8-ff2380f6bdaa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:57.295157 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-774d314b-143c-417d-8ef8-ff2380f6bdaa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:57.295650 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-774d314b-143c-417d-8ef8-ff2380f6bdaa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:57.296368 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-774d314b-143c-417d-8ef8-ff2380f6bdaa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:57.296791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-774d314b-143c-417d-8ef8-ff2380f6bdaa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:57.297253 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-774d314b-143c-417d-8ef8-ff2380f6bdaa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:57.297764 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-774d314b-143c-417d-8ef8-ff2380f6bdaa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:57.446157 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-774d314b-143c-417d-8ef8-ff2380f6bdaa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:57.454369 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-774d314b-143c-417d-8ef8-ff2380f6bdaa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.170419 Sep 16 08:05:57.454979 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 41/95] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:57 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:57.475525 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cc611b30-3455-4e6e-ac8b-96972c4359a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:57.476130 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cc611b30-3455-4e6e-ac8b-96972c4359a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:57.490197 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cc611b30-3455-4e6e-ac8b-96972c4359a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:57.490734 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cc611b30-3455-4e6e-ac8b-96972c4359a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:57.491175 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cc611b30-3455-4e6e-ac8b-96972c4359a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:57.491878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cc611b30-3455-4e6e-ac8b-96972c4359a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:57.492388 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cc611b30-3455-4e6e-ac8b-96972c4359a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:57.492741 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cc611b30-3455-4e6e-ac8b-96972c4359a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:57.640108 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cc611b30-3455-4e6e-ac8b-96972c4359a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:57.648647 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cc611b30-3455-4e6e-ac8b-96972c4359a4 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.180922 Sep 16 08:05:57.649504 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 55/96] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:57 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:57.780212 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a5df31e9-9e58-4361-b636-8fc9b3f87ae6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:57.780804 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a5df31e9-9e58-4361-b636-8fc9b3f87ae6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:57.787864 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5df31e9-9e58-4361-b636-8fc9b3f87ae6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:57.788373 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5df31e9-9e58-4361-b636-8fc9b3f87ae6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:57.788828 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5df31e9-9e58-4361-b636-8fc9b3f87ae6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:57.789553 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5df31e9-9e58-4361-b636-8fc9b3f87ae6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:57.789999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5df31e9-9e58-4361-b636-8fc9b3f87ae6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:57.790420 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5df31e9-9e58-4361-b636-8fc9b3f87ae6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:57.925362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a5df31e9-9e58-4361-b636-8fc9b3f87ae6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:57.935863 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a5df31e9-9e58-4361-b636-8fc9b3f87ae6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.159436 Sep 16 08:05:57.936434 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 42/97] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:57 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:58.001156 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-fcb1fc45-75d4-4bd7-bf8b-a8ec712130ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:58.001816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-fcb1fc45-75d4-4bd7-bf8b-a8ec712130ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:58.008174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fcb1fc45-75d4-4bd7-bf8b-a8ec712130ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:58.008655 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fcb1fc45-75d4-4bd7-bf8b-a8ec712130ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:58.009094 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fcb1fc45-75d4-4bd7-bf8b-a8ec712130ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:58.009783 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fcb1fc45-75d4-4bd7-bf8b-a8ec712130ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:58.010241 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fcb1fc45-75d4-4bd7-bf8b-a8ec712130ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:58.010666 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fcb1fc45-75d4-4bd7-bf8b-a8ec712130ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:58.147798 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-fcb1fc45-75d4-4bd7-bf8b-a8ec712130ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:58.155347 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-fcb1fc45-75d4-4bd7-bf8b-a8ec712130ff tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.158028 Sep 16 08:05:58.155915 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 56/98] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:57 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:58.480316 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-80ce68e7-b599-41a6-b852-929301f1361a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:58.481192 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-80ce68e7-b599-41a6-b852-929301f1361a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:58.488422 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80ce68e7-b599-41a6-b852-929301f1361a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:58.489045 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80ce68e7-b599-41a6-b852-929301f1361a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:58.490229 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80ce68e7-b599-41a6-b852-929301f1361a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:58.491191 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80ce68e7-b599-41a6-b852-929301f1361a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:58.491789 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80ce68e7-b599-41a6-b852-929301f1361a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:58.492409 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80ce68e7-b599-41a6-b852-929301f1361a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:58.672774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2d982f88-d5a6-4a5f-900d-23e67836c962 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:58.673579 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2d982f88-d5a6-4a5f-900d-23e67836c962 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:58.687762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2d982f88-d5a6-4a5f-900d-23e67836c962 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:58.688420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2d982f88-d5a6-4a5f-900d-23e67836c962 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:58.689022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2d982f88-d5a6-4a5f-900d-23e67836c962 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:58.694164 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2d982f88-d5a6-4a5f-900d-23e67836c962 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:58.694164 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2d982f88-d5a6-4a5f-900d-23e67836c962 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:58.694164 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2d982f88-d5a6-4a5f-900d-23e67836c962 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:58.752887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-80ce68e7-b599-41a6-b852-929301f1361a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:58.767130 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-80ce68e7-b599-41a6-b852-929301f1361a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.292798 Sep 16 08:05:58.779723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 43/99] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:58 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:58.861998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2d982f88-d5a6-4a5f-900d-23e67836c962 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:58.871028 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2d982f88-d5a6-4a5f-900d-23e67836c962 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.202229 Sep 16 08:05:58.871650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 57/100] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:58 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:58.961515 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c0f2623c-5f6e-43d1-9f7a-7ad6f75ccd84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:58.962086 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c0f2623c-5f6e-43d1-9f7a-7ad6f75ccd84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:58.968163 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c0f2623c-5f6e-43d1-9f7a-7ad6f75ccd84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:58.968765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c0f2623c-5f6e-43d1-9f7a-7ad6f75ccd84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:58.976265 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c0f2623c-5f6e-43d1-9f7a-7ad6f75ccd84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:58.976265 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c0f2623c-5f6e-43d1-9f7a-7ad6f75ccd84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:58.976265 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c0f2623c-5f6e-43d1-9f7a-7ad6f75ccd84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:58.976265 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c0f2623c-5f6e-43d1-9f7a-7ad6f75ccd84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:59.120722 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c0f2623c-5f6e-43d1-9f7a-7ad6f75ccd84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:59.129022 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c0f2623c-5f6e-43d1-9f7a-7ad6f75ccd84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.172424 Sep 16 08:05:59.130146 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 44/101] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:58 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:05:59.179079 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7889bcec-bb8b-4404-a415-a5530681dc9d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:59.179782 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7889bcec-bb8b-4404-a415-a5530681dc9d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:59.185918 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7889bcec-bb8b-4404-a415-a5530681dc9d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:59.186402 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7889bcec-bb8b-4404-a415-a5530681dc9d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:59.187084 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7889bcec-bb8b-4404-a415-a5530681dc9d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:59.187941 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7889bcec-bb8b-4404-a415-a5530681dc9d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:59.188429 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7889bcec-bb8b-4404-a415-a5530681dc9d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:59.188854 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7889bcec-bb8b-4404-a415-a5530681dc9d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:59.338987 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7889bcec-bb8b-4404-a415-a5530681dc9d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:59.347184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7889bcec-bb8b-4404-a415-a5530681dc9d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.172327 Sep 16 08:05:59.348063 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 58/102] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:59 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:05:59.792949 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-80733eca-1660-491b-b7c8-5060459d961f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:59.794012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-80733eca-1660-491b-b7c8-5060459d961f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:59.800295 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80733eca-1660-491b-b7c8-5060459d961f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:59.801218 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80733eca-1660-491b-b7c8-5060459d961f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:59.801844 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80733eca-1660-491b-b7c8-5060459d961f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:59.803069 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80733eca-1660-491b-b7c8-5060459d961f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:59.803671 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80733eca-1660-491b-b7c8-5060459d961f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:59.804249 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80733eca-1660-491b-b7c8-5060459d961f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:59.896040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-92c55620-7be1-4cb0-b4c6-8b49e9da411d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:05:59.896746 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-92c55620-7be1-4cb0-b4c6-8b49e9da411d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:05:59.903296 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-92c55620-7be1-4cb0-b4c6-8b49e9da411d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:59.903893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-92c55620-7be1-4cb0-b4c6-8b49e9da411d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:59.904441 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-92c55620-7be1-4cb0-b4c6-8b49e9da411d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:59.905235 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-92c55620-7be1-4cb0-b4c6-8b49e9da411d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:05:59.905809 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-92c55620-7be1-4cb0-b4c6-8b49e9da411d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:05:59.906327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-92c55620-7be1-4cb0-b4c6-8b49e9da411d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:05:59.947573 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-80733eca-1660-491b-b7c8-5060459d961f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:05:59.955607 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-80733eca-1660-491b-b7c8-5060459d961f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.167217 Sep 16 08:05:59.956187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 45/103] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:59 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:00.044091 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-92c55620-7be1-4cb0-b4c6-8b49e9da411d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:00.053122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-92c55620-7be1-4cb0-b4c6-8b49e9da411d tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.160300 Sep 16 08:06:00.054988 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 59/104] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:05:59 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:06:00.155867 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b836c1d4-6e6c-496f-bb47-4af453e16cfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:00.156596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b836c1d4-6e6c-496f-bb47-4af453e16cfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:00.163366 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b836c1d4-6e6c-496f-bb47-4af453e16cfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:00.163856 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b836c1d4-6e6c-496f-bb47-4af453e16cfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:00.164274 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b836c1d4-6e6c-496f-bb47-4af453e16cfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:00.164962 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b836c1d4-6e6c-496f-bb47-4af453e16cfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:00.165457 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b836c1d4-6e6c-496f-bb47-4af453e16cfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:00.165874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b836c1d4-6e6c-496f-bb47-4af453e16cfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:00.303055 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b836c1d4-6e6c-496f-bb47-4af453e16cfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:00.309271 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b836c1d4-6e6c-496f-bb47-4af453e16cfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.157273 Sep 16 08:06:00.309852 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 46/105] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:00 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:00.378397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cc3120ee-4dd6-430b-a810-152f39c8171a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:00.379031 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cc3120ee-4dd6-430b-a810-152f39c8171a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:00.385019 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cc3120ee-4dd6-430b-a810-152f39c8171a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:00.385501 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cc3120ee-4dd6-430b-a810-152f39c8171a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:00.385985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cc3120ee-4dd6-430b-a810-152f39c8171a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:00.386600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cc3120ee-4dd6-430b-a810-152f39c8171a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:00.387073 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cc3120ee-4dd6-430b-a810-152f39c8171a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:00.387585 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cc3120ee-4dd6-430b-a810-152f39c8171a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:00.563258 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cc3120ee-4dd6-430b-a810-152f39c8171a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:00.579711 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cc3120ee-4dd6-430b-a810-152f39c8171a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.205041 Sep 16 08:06:00.580407 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 60/106] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:00 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:00.981582 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b2e1330f-0c97-47f3-93cc-1f5d6a811ed4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:00.982339 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b2e1330f-0c97-47f3-93cc-1f5d6a811ed4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:00.989970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2e1330f-0c97-47f3-93cc-1f5d6a811ed4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:00.995213 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2e1330f-0c97-47f3-93cc-1f5d6a811ed4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:00.995213 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2e1330f-0c97-47f3-93cc-1f5d6a811ed4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:00.995213 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2e1330f-0c97-47f3-93cc-1f5d6a811ed4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:00.995213 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2e1330f-0c97-47f3-93cc-1f5d6a811ed4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:00.995760 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2e1330f-0c97-47f3-93cc-1f5d6a811ed4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:01.077750 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-574fd278-7d88-45db-b27d-db7de50db61b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:01.078363 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-574fd278-7d88-45db-b27d-db7de50db61b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:01.091220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-574fd278-7d88-45db-b27d-db7de50db61b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:01.092350 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-574fd278-7d88-45db-b27d-db7de50db61b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:01.093015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-574fd278-7d88-45db-b27d-db7de50db61b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:01.094403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-574fd278-7d88-45db-b27d-db7de50db61b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:01.095060 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-574fd278-7d88-45db-b27d-db7de50db61b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:01.095696 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-574fd278-7d88-45db-b27d-db7de50db61b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:01.171683 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b2e1330f-0c97-47f3-93cc-1f5d6a811ed4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:01.180536 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b2e1330f-0c97-47f3-93cc-1f5d6a811ed4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.203497 Sep 16 08:06:01.181681 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 47/107] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:00 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:01.244689 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-574fd278-7d88-45db-b27d-db7de50db61b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:01.253684 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-574fd278-7d88-45db-b27d-db7de50db61b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.179989 Sep 16 08:06:01.254596 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 61/108] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:01 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:06:01.332275 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-24ee9499-428f-4cd8-96b1-bfafd8673f57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:01.332977 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-24ee9499-428f-4cd8-96b1-bfafd8673f57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:01.339022 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24ee9499-428f-4cd8-96b1-bfafd8673f57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:01.339564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24ee9499-428f-4cd8-96b1-bfafd8673f57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:01.340002 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24ee9499-428f-4cd8-96b1-bfafd8673f57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:01.340771 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24ee9499-428f-4cd8-96b1-bfafd8673f57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:01.341225 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24ee9499-428f-4cd8-96b1-bfafd8673f57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:01.341653 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24ee9499-428f-4cd8-96b1-bfafd8673f57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:01.346207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=100 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:01.494074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-24ee9499-428f-4cd8-96b1-bfafd8673f57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:01.505516 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-24ee9499-428f-4cd8-96b1-bfafd8673f57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.176622 Sep 16 08:06:01.506407 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 48/109] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:01 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:01.604212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2edce1de-a5cd-4ab7-9201-8006568694a9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:01.604827 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2edce1de-a5cd-4ab7-9201-8006568694a9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:01.611278 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2edce1de-a5cd-4ab7-9201-8006568694a9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:01.611770 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2edce1de-a5cd-4ab7-9201-8006568694a9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:01.612206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2edce1de-a5cd-4ab7-9201-8006568694a9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:01.612906 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2edce1de-a5cd-4ab7-9201-8006568694a9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:01.613357 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2edce1de-a5cd-4ab7-9201-8006568694a9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:01.613861 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2edce1de-a5cd-4ab7-9201-8006568694a9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:01.768107 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2edce1de-a5cd-4ab7-9201-8006568694a9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:01.791520 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2edce1de-a5cd-4ab7-9201-8006568694a9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.179474 Sep 16 08:06:01.792463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 62/110] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:01 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:01.809180 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-524e3f77-0dd7-43e5-b9d5-62250f833163 req-77cafa1a-97a9-4db2-bba2-27b0e0b9092e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddef20f-e546-46b6-9282-f4fb7fc9cb86", "name": "network-vif-plugged", "status": "completed", "tag": "7ba33ab1-123d-4e11-ba3e-f820f20c39b8"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:06:01.821309 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-524e3f77-0dd7-43e5-b9d5-62250f833163 req-77cafa1a-97a9-4db2-bba2-27b0e0b9092e service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:01.821784 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-524e3f77-0dd7-43e5-b9d5-62250f833163 req-77cafa1a-97a9-4db2-bba2-27b0e0b9092e service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:01.822209 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-524e3f77-0dd7-43e5-b9d5-62250f833163 req-77cafa1a-97a9-4db2-bba2-27b0e0b9092e service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:01.840835 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-524e3f77-0dd7-43e5-b9d5-62250f833163 req-77cafa1a-97a9-4db2-bba2-27b0e0b9092e service nova] Creating event network-vif-plugged:7ba33ab1-123d-4e11-ba3e-f820f20c39b8 for instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 on hv-cinder-74014 Sep 16 08:06:01.841345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-524e3f77-0dd7-43e5-b9d5-62250f833163 req-77cafa1a-97a9-4db2-bba2-27b0e0b9092e service nova] Acquiring lock "compute-rpcapi-router" {{(pid=121047) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:312}} Sep 16 08:06:01.841789 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-524e3f77-0dd7-43e5-b9d5-62250f833163 req-77cafa1a-97a9-4db2-bba2-27b0e0b9092e service nova] Acquired lock "compute-rpcapi-router" {{(pid=121047) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:315}} Sep 16 08:06:01.842818 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec400c74-4d71-452e-b6e7-8e06e0c4040a None None] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:01.843320 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec400c74-4d71-452e-b6e7-8e06e0c4040a None None] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:01.843736 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec400c74-4d71-452e-b6e7-8e06e0c4040a None None] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:01.844434 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec400c74-4d71-452e-b6e7-8e06e0c4040a None None] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:01.844876 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec400c74-4d71-452e-b6e7-8e06e0c4040a None None] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:01.845298 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec400c74-4d71-452e-b6e7-8e06e0c4040a None None] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:01.854496 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.compute.rpcapi [None req-ec400c74-4d71-452e-b6e7-8e06e0c4040a None None] Automatically selected compute RPC version 6.1 from minimum service version 64 Sep 16 08:06:01.855422 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec400c74-4d71-452e-b6e7-8e06e0c4040a None None] Releasing lock "compute-rpcapi-router" {{(pid=121047) lock /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:333}} Sep 16 08:06:01.871339 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ec400c74-4d71-452e-b6e7-8e06e0c4040a None None] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.142858 Sep 16 08:06:01.871948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 49/111] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:06:01 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 144 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:06:02.209698 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c811f97b-5246-4b5c-88c3-b075b1867464 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:02.212065 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c811f97b-5246-4b5c-88c3-b075b1867464 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:02.227334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c811f97b-5246-4b5c-88c3-b075b1867464 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:02.228023 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c811f97b-5246-4b5c-88c3-b075b1867464 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:02.228761 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c811f97b-5246-4b5c-88c3-b075b1867464 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:02.229618 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c811f97b-5246-4b5c-88c3-b075b1867464 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:02.230065 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c811f97b-5246-4b5c-88c3-b075b1867464 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:02.230767 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c811f97b-5246-4b5c-88c3-b075b1867464 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:02.278142 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-01d52b04-3695-436f-a06c-2520d9c59895 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:02.279490 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-01d52b04-3695-436f-a06c-2520d9c59895 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:02.287169 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01d52b04-3695-436f-a06c-2520d9c59895 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:02.287939 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01d52b04-3695-436f-a06c-2520d9c59895 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:02.288579 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01d52b04-3695-436f-a06c-2520d9c59895 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:02.289444 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01d52b04-3695-436f-a06c-2520d9c59895 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:02.290091 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01d52b04-3695-436f-a06c-2520d9c59895 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:02.290673 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01d52b04-3695-436f-a06c-2520d9c59895 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:02.393735 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c811f97b-5246-4b5c-88c3-b075b1867464 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:02.402121 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c811f97b-5246-4b5c-88c3-b075b1867464 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.200577 Sep 16 08:06:02.402737 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 63/112] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:02 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:02.532503 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5b691d69-4505-477b-8612-901a26800603 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:02.533525 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5b691d69-4505-477b-8612-901a26800603 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:02.540665 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b691d69-4505-477b-8612-901a26800603 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:02.541635 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b691d69-4505-477b-8612-901a26800603 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:02.542303 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b691d69-4505-477b-8612-901a26800603 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:02.543040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b691d69-4505-477b-8612-901a26800603 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:02.543529 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b691d69-4505-477b-8612-901a26800603 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:02.543913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b691d69-4505-477b-8612-901a26800603 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:02.699390 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-01d52b04-3695-436f-a06c-2520d9c59895 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:02.717512 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-01d52b04-3695-436f-a06c-2520d9c59895 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.433666 Sep 16 08:06:02.717512 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 50/113] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:02 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:06:02.782055 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5b691d69-4505-477b-8612-901a26800603 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:02.796375 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5b691d69-4505-477b-8612-901a26800603 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.265255 Sep 16 08:06:02.802786 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 64/114] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:02 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:06:02.819674 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-93c69820-91a5-45d7-b380-b2f9733b1e6c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:02.820303 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-93c69820-91a5-45d7-b380-b2f9733b1e6c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:02.827191 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-93c69820-91a5-45d7-b380-b2f9733b1e6c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:02.827627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-93c69820-91a5-45d7-b380-b2f9733b1e6c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:02.828400 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-93c69820-91a5-45d7-b380-b2f9733b1e6c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:02.829125 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-93c69820-91a5-45d7-b380-b2f9733b1e6c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:02.829641 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-93c69820-91a5-45d7-b380-b2f9733b1e6c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:02.830012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-93c69820-91a5-45d7-b380-b2f9733b1e6c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:03.038489 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-93c69820-91a5-45d7-b380-b2f9733b1e6c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:03.049222 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-93c69820-91a5-45d7-b380-b2f9733b1e6c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.237674 Sep 16 08:06:03.049795 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 51/115] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:02 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:03.429569 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2026b601-99e0-4b95-a0fa-55bc20bf608a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:03.433360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2026b601-99e0-4b95-a0fa-55bc20bf608a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:03.439429 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2026b601-99e0-4b95-a0fa-55bc20bf608a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:03.439919 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2026b601-99e0-4b95-a0fa-55bc20bf608a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:03.440356 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2026b601-99e0-4b95-a0fa-55bc20bf608a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:03.441125 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2026b601-99e0-4b95-a0fa-55bc20bf608a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:03.441600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2026b601-99e0-4b95-a0fa-55bc20bf608a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:03.442003 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2026b601-99e0-4b95-a0fa-55bc20bf608a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:03.594355 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2026b601-99e0-4b95-a0fa-55bc20bf608a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:03.605677 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2026b601-99e0-4b95-a0fa-55bc20bf608a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.182673 Sep 16 08:06:03.606308 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 65/116] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:03 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:03.730238 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f908f22b-7cf9-41ae-87e7-a6d6aa5f5095 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:03.730960 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f908f22b-7cf9-41ae-87e7-a6d6aa5f5095 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:03.736994 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f908f22b-7cf9-41ae-87e7-a6d6aa5f5095 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:03.737473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f908f22b-7cf9-41ae-87e7-a6d6aa5f5095 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:03.737909 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f908f22b-7cf9-41ae-87e7-a6d6aa5f5095 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:03.738598 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f908f22b-7cf9-41ae-87e7-a6d6aa5f5095 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:03.739074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f908f22b-7cf9-41ae-87e7-a6d6aa5f5095 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:03.739539 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f908f22b-7cf9-41ae-87e7-a6d6aa5f5095 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:03.823366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0fce2de8-7d78-4bc6-a281-e9459e79e619 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:03.824107 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0fce2de8-7d78-4bc6-a281-e9459e79e619 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:03.830895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0fce2de8-7d78-4bc6-a281-e9459e79e619 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:03.831460 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0fce2de8-7d78-4bc6-a281-e9459e79e619 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:03.831993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0fce2de8-7d78-4bc6-a281-e9459e79e619 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:03.832773 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0fce2de8-7d78-4bc6-a281-e9459e79e619 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:03.833942 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0fce2de8-7d78-4bc6-a281-e9459e79e619 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:03.834428 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0fce2de8-7d78-4bc6-a281-e9459e79e619 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:03.892986 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f908f22b-7cf9-41ae-87e7-a6d6aa5f5095 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:03.904052 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f908f22b-7cf9-41ae-87e7-a6d6aa5f5095 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.177704 Sep 16 08:06:03.905116 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 52/117] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:03 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:04.002924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0fce2de8-7d78-4bc6-a281-e9459e79e619 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:04.011616 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0fce2de8-7d78-4bc6-a281-e9459e79e619 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.192306 Sep 16 08:06:04.012245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 66/118] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:03 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:06:04.074519 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f7aa7e11-69fe-4181-b145-09d837acdacf tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:04.076073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f7aa7e11-69fe-4181-b145-09d837acdacf tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:04.085299 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7aa7e11-69fe-4181-b145-09d837acdacf tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:04.086314 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7aa7e11-69fe-4181-b145-09d837acdacf tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:04.087289 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7aa7e11-69fe-4181-b145-09d837acdacf tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:04.088123 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7aa7e11-69fe-4181-b145-09d837acdacf tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:04.088651 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7aa7e11-69fe-4181-b145-09d837acdacf tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:04.089322 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7aa7e11-69fe-4181-b145-09d837acdacf tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:04.161168 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-284d2d63-c850-4566-8269-d7ee2458d188 req-fcee9736-2461-4431-a96f-60db13a06efc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547e4d8b-02bd-4033-82b3-04db0ba60fe5", "name": "network-vif-plugged", "status": "completed", "tag": "047136d4-f91b-4e74-bfe8-7505cf1c706e"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:06:04.171557 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-284d2d63-c850-4566-8269-d7ee2458d188 req-fcee9736-2461-4431-a96f-60db13a06efc service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:04.172021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-284d2d63-c850-4566-8269-d7ee2458d188 req-fcee9736-2461-4431-a96f-60db13a06efc service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:04.172456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-284d2d63-c850-4566-8269-d7ee2458d188 req-fcee9736-2461-4431-a96f-60db13a06efc service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:04.176392 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:04.184427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-284d2d63-c850-4566-8269-d7ee2458d188 req-fcee9736-2461-4431-a96f-60db13a06efc service nova] Creating event network-vif-plugged:047136d4-f91b-4e74-bfe8-7505cf1c706e for instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 on hv-cinder-74014 Sep 16 08:06:04.189509 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-284d2d63-c850-4566-8269-d7ee2458d188 req-fcee9736-2461-4431-a96f-60db13a06efc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032592 Sep 16 08:06:04.190832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 67/119] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:06:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:06:04.229560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f7aa7e11-69fe-4181-b145-09d837acdacf tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:04.237187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f7aa7e11-69fe-4181-b145-09d837acdacf tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.167189 Sep 16 08:06:04.237746 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 53/120] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:04 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:06:04.630568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c486e625-0836-472d-89c1-7eb0e8462c0f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:04.633638 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c486e625-0836-472d-89c1-7eb0e8462c0f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:04.642906 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c486e625-0836-472d-89c1-7eb0e8462c0f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:04.643784 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c486e625-0836-472d-89c1-7eb0e8462c0f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:04.644559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c486e625-0836-472d-89c1-7eb0e8462c0f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:04.645777 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c486e625-0836-472d-89c1-7eb0e8462c0f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:04.646398 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c486e625-0836-472d-89c1-7eb0e8462c0f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:04.647053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c486e625-0836-472d-89c1-7eb0e8462c0f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:04.909822 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c486e625-0836-472d-89c1-7eb0e8462c0f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:04.924523 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c486e625-0836-472d-89c1-7eb0e8462c0f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.298868 Sep 16 08:06:04.925556 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 68/121] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:04 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:06:04.933440 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ac69554b-bf51-410d-8b39-520e7f977ed8 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:04.934050 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ac69554b-bf51-410d-8b39-520e7f977ed8 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:04.940316 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ac69554b-bf51-410d-8b39-520e7f977ed8 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:04.941051 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ac69554b-bf51-410d-8b39-520e7f977ed8 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:04.941542 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ac69554b-bf51-410d-8b39-520e7f977ed8 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:04.942471 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ac69554b-bf51-410d-8b39-520e7f977ed8 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:04.943105 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ac69554b-bf51-410d-8b39-520e7f977ed8 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:04.943578 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ac69554b-bf51-410d-8b39-520e7f977ed8 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:05.035444 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6e339b99-87ab-47e7-b82a-379743910814 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:05.036047 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6e339b99-87ab-47e7-b82a-379743910814 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:05.042791 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6e339b99-87ab-47e7-b82a-379743910814 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:05.043453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6e339b99-87ab-47e7-b82a-379743910814 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:05.045563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6e339b99-87ab-47e7-b82a-379743910814 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:05.045563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6e339b99-87ab-47e7-b82a-379743910814 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:05.045563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6e339b99-87ab-47e7-b82a-379743910814 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:05.045563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6e339b99-87ab-47e7-b82a-379743910814 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:05.101133 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ac69554b-bf51-410d-8b39-520e7f977ed8 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:05.110322 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ac69554b-bf51-410d-8b39-520e7f977ed8 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1315 microversion: 2.1 time: 0.180656 Sep 16 08:06:05.126709 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 54/122] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:04 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1315 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:05.224789 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6e339b99-87ab-47e7-b82a-379743910814 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:05.232775 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6e339b99-87ab-47e7-b82a-379743910814 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.201386 Sep 16 08:06:05.239269 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 69/123] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:05 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:05.262317 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d8541ded-3ff5-4522-83a1-6a96fc33c167 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:05.263225 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d8541ded-3ff5-4522-83a1-6a96fc33c167 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:05.269521 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8541ded-3ff5-4522-83a1-6a96fc33c167 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:05.269994 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8541ded-3ff5-4522-83a1-6a96fc33c167 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:05.270420 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8541ded-3ff5-4522-83a1-6a96fc33c167 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:05.271754 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8541ded-3ff5-4522-83a1-6a96fc33c167 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:05.272205 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8541ded-3ff5-4522-83a1-6a96fc33c167 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:05.272707 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8541ded-3ff5-4522-83a1-6a96fc33c167 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:05.415187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d8541ded-3ff5-4522-83a1-6a96fc33c167 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:05.422697 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d8541ded-3ff5-4522-83a1-6a96fc33c167 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.164392 Sep 16 08:06:05.423320 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 55/124] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:05 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:05.948518 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e764e660-3647-4bb4-893c-3d2d22344089 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:05.950709 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e764e660-3647-4bb4-893c-3d2d22344089 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:05.956717 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e764e660-3647-4bb4-893c-3d2d22344089 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:05.957203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e764e660-3647-4bb4-893c-3d2d22344089 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:05.957859 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e764e660-3647-4bb4-893c-3d2d22344089 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:05.958650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e764e660-3647-4bb4-893c-3d2d22344089 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:05.959153 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e764e660-3647-4bb4-893c-3d2d22344089 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:05.959728 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e764e660-3647-4bb4-893c-3d2d22344089 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:06.105346 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e764e660-3647-4bb4-893c-3d2d22344089 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:06.114999 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e764e660-3647-4bb4-893c-3d2d22344089 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.169847 Sep 16 08:06:06.115596 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 70/125] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:05 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:06.141716 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-8588be39-7b5c-42ce-9e62-d745f8a2dbe2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:06.147811 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-8588be39-7b5c-42ce-9e62-d745f8a2dbe2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:06.154137 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8588be39-7b5c-42ce-9e62-d745f8a2dbe2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:06.154726 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8588be39-7b5c-42ce-9e62-d745f8a2dbe2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:06.155245 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8588be39-7b5c-42ce-9e62-d745f8a2dbe2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:06.156022 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8588be39-7b5c-42ce-9e62-d745f8a2dbe2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:06.156992 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8588be39-7b5c-42ce-9e62-d745f8a2dbe2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:06.157571 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8588be39-7b5c-42ce-9e62-d745f8a2dbe2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:06.206896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-60cbb6b3-c4c4-4fbb-955d-53efc71c90a7 req-2240021d-2dbb-4024-91d1-01d5d36dbb84 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e123e7-4239-4c3a-8e4b-363f1a2bc058", "name": "network-vif-plugged", "status": "completed", "tag": "27b13be5-f0af-474b-bcb2-8afc268cf10e"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:06:06.217604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-60cbb6b3-c4c4-4fbb-955d-53efc71c90a7 req-2240021d-2dbb-4024-91d1-01d5d36dbb84 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:06.218294 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-60cbb6b3-c4c4-4fbb-955d-53efc71c90a7 req-2240021d-2dbb-4024-91d1-01d5d36dbb84 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:06.219034 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-60cbb6b3-c4c4-4fbb-955d-53efc71c90a7 req-2240021d-2dbb-4024-91d1-01d5d36dbb84 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:06.231680 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-60cbb6b3-c4c4-4fbb-955d-53efc71c90a7 req-2240021d-2dbb-4024-91d1-01d5d36dbb84 service nova] Creating event network-vif-plugged:27b13be5-f0af-474b-bcb2-8afc268cf10e for instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 on hv-cinder-74014 Sep 16 08:06:06.237391 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-60cbb6b3-c4c4-4fbb-955d-53efc71c90a7 req-2240021d-2dbb-4024-91d1-01d5d36dbb84 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035663 Sep 16 08:06:06.238674 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 71/126] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:06:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:06:06.260697 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-83e77240-98de-4deb-8516-8ad9efb96666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:06.260697 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-83e77240-98de-4deb-8516-8ad9efb96666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:06.268492 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-83e77240-98de-4deb-8516-8ad9efb96666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:06.269472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-83e77240-98de-4deb-8516-8ad9efb96666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:06.270384 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-83e77240-98de-4deb-8516-8ad9efb96666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:06.271368 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-83e77240-98de-4deb-8516-8ad9efb96666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:06.271972 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-83e77240-98de-4deb-8516-8ad9efb96666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:06.272643 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-83e77240-98de-4deb-8516-8ad9efb96666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:06.330897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-8588be39-7b5c-42ce-9e62-d745f8a2dbe2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:06.340610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-8588be39-7b5c-42ce-9e62-d745f8a2dbe2 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1503 microversion: 2.1 time: 0.207576 Sep 16 08:06:06.342090 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 56/127] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:06 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1503 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:06.446887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c166cc9e-af07-45e5-94a7-819df4f0f87e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:06.447825 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c166cc9e-af07-45e5-94a7-819df4f0f87e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:06.462364 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c166cc9e-af07-45e5-94a7-819df4f0f87e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:06.462930 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c166cc9e-af07-45e5-94a7-819df4f0f87e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:06.463422 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c166cc9e-af07-45e5-94a7-819df4f0f87e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:06.466841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c166cc9e-af07-45e5-94a7-819df4f0f87e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:06.467991 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c166cc9e-af07-45e5-94a7-819df4f0f87e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:06.469587 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c166cc9e-af07-45e5-94a7-819df4f0f87e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:06.629027 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-83e77240-98de-4deb-8516-8ad9efb96666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:06.652802 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-83e77240-98de-4deb-8516-8ad9efb96666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.398926 Sep 16 08:06:06.656513 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 72/128] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:06 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 403 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:06:06.733630 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c166cc9e-af07-45e5-94a7-819df4f0f87e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:06.747843 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c166cc9e-af07-45e5-94a7-819df4f0f87e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1365 microversion: 2.1 time: 0.306067 Sep 16 08:06:06.748815 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 57/129] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:06 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1365 bytes in 308 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:06:07.137413 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6317281e-da25-46cb-bb7b-6d9e64313293 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:07.138105 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6317281e-da25-46cb-bb7b-6d9e64313293 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:07.144747 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6317281e-da25-46cb-bb7b-6d9e64313293 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:07.145275 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6317281e-da25-46cb-bb7b-6d9e64313293 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:07.147273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6317281e-da25-46cb-bb7b-6d9e64313293 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:07.149145 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6317281e-da25-46cb-bb7b-6d9e64313293 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:07.149629 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6317281e-da25-46cb-bb7b-6d9e64313293 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:07.150060 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6317281e-da25-46cb-bb7b-6d9e64313293 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:07.331196 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6317281e-da25-46cb-bb7b-6d9e64313293 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:07.352009 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6317281e-da25-46cb-bb7b-6d9e64313293 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.208209 Sep 16 08:06:07.352009 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 73/130] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:07 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:07.680194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1568e749-4ec7-49b8-8963-d883c933c9ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:07.680875 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1568e749-4ec7-49b8-8963-d883c933c9ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:07.686973 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1568e749-4ec7-49b8-8963-d883c933c9ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:07.687537 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1568e749-4ec7-49b8-8963-d883c933c9ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:07.688032 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1568e749-4ec7-49b8-8963-d883c933c9ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:07.688810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1568e749-4ec7-49b8-8963-d883c933c9ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:07.689378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1568e749-4ec7-49b8-8963-d883c933c9ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:07.689882 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1568e749-4ec7-49b8-8963-d883c933c9ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:07.773597 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ec816f6f-3a24-4bfe-b535-653cdd6697b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:07.774314 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ec816f6f-3a24-4bfe-b535-653cdd6697b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:07.780643 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ec816f6f-3a24-4bfe-b535-653cdd6697b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:07.781327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ec816f6f-3a24-4bfe-b535-653cdd6697b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:07.782501 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ec816f6f-3a24-4bfe-b535-653cdd6697b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:07.783439 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ec816f6f-3a24-4bfe-b535-653cdd6697b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:07.783901 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ec816f6f-3a24-4bfe-b535-653cdd6697b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:07.784353 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ec816f6f-3a24-4bfe-b535-653cdd6697b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:07.854717 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1568e749-4ec7-49b8-8963-d883c933c9ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:07.862518 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1568e749-4ec7-49b8-8963-d883c933c9ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.186166 Sep 16 08:06:07.863143 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 58/131] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:07 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:07.954800 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ec816f6f-3a24-4bfe-b535-653cdd6697b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:07.973509 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ec816f6f-3a24-4bfe-b535-653cdd6697b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1554 microversion: 2.1 time: 0.196152 Sep 16 08:06:07.973509 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 74/132] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:07 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1554 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:06:07.994920 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7e1f0841-5d5f-4b1a-992c-07eb768edf04 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:08.005443 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7e1f0841-5d5f-4b1a-992c-07eb768edf04 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:08.005443 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7e1f0841-5d5f-4b1a-992c-07eb768edf04 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:08.005443 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7e1f0841-5d5f-4b1a-992c-07eb768edf04 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:08.005443 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7e1f0841-5d5f-4b1a-992c-07eb768edf04 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:08.005905 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7e1f0841-5d5f-4b1a-992c-07eb768edf04 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:08.005905 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7e1f0841-5d5f-4b1a-992c-07eb768edf04 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:08.005905 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7e1f0841-5d5f-4b1a-992c-07eb768edf04 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:08.118998 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7e1f0841-5d5f-4b1a-992c-07eb768edf04 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.127969 Sep 16 08:06:08.120824 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 59/133] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Sep 16 08:06:07 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/os-interface => generated 284 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:06:08.253315 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-8a13bf1b-4a05-499f-a645-00d4b5a66b25 req-bbb82079-ba66-4854-afa7-d1f2e15c6e9a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe69a551-c89a-4b4f-a026-5e23f39a1355", "name": "network-vif-plugged", "status": "completed", "tag": "8a64e1a8-08fe-42cc-84de-a5e3362d89fc"}, {"server_uuid": "d6ed2e44-f810-44fb-96f8-50847e08026e", "name": "network-vif-plugged", "status": "completed", "tag": "c9911fe4-6d13-4e4b-9a6e-7699e12bfdc4"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:06:08.273690 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-8a13bf1b-4a05-499f-a645-00d4b5a66b25 req-bbb82079-ba66-4854-afa7-d1f2e15c6e9a service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:08.274232 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-8a13bf1b-4a05-499f-a645-00d4b5a66b25 req-bbb82079-ba66-4854-afa7-d1f2e15c6e9a service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:08.279839 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-8a13bf1b-4a05-499f-a645-00d4b5a66b25 req-bbb82079-ba66-4854-afa7-d1f2e15c6e9a service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:08.289959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-8a13bf1b-4a05-499f-a645-00d4b5a66b25 req-bbb82079-ba66-4854-afa7-d1f2e15c6e9a service nova] Creating event network-vif-plugged:8a64e1a8-08fe-42cc-84de-a5e3362d89fc for instance fe69a551-c89a-4b4f-a026-5e23f39a1355 on hv-cinder-74014 Sep 16 08:06:08.291751 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-8a13bf1b-4a05-499f-a645-00d4b5a66b25 req-bbb82079-ba66-4854-afa7-d1f2e15c6e9a service nova] Creating event network-vif-plugged:c9911fe4-6d13-4e4b-9a6e-7699e12bfdc4 for instance d6ed2e44-f810-44fb-96f8-50847e08026e on hv-cinder-74014 Sep 16 08:06:08.299646 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-8a13bf1b-4a05-499f-a645-00d4b5a66b25 req-bbb82079-ba66-4854-afa7-d1f2e15c6e9a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 354 microversion: 2.1 time: 0.049913 Sep 16 08:06:08.300352 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 75/134] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:06:08 2022] POST /compute/v2.1/os-server-external-events => generated 354 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:06:08.365438 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-10936b11-9a43-4833-ae88-465018b84d57 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:08.368898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-10936b11-9a43-4833-ae88-465018b84d57 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:08.382363 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-10936b11-9a43-4833-ae88-465018b84d57 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:08.382925 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-10936b11-9a43-4833-ae88-465018b84d57 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:08.383365 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-10936b11-9a43-4833-ae88-465018b84d57 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:08.384069 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-10936b11-9a43-4833-ae88-465018b84d57 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:08.384520 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-10936b11-9a43-4833-ae88-465018b84d57 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:08.384941 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-10936b11-9a43-4833-ae88-465018b84d57 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:08.545707 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-10936b11-9a43-4833-ae88-465018b84d57 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:08.554730 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-10936b11-9a43-4833-ae88-465018b84d57 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.193074 Sep 16 08:06:08.555615 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 60/135] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:08 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:08.886933 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6aa9edd7-c001-4d4e-838b-265222ee2269 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:08.897893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6aa9edd7-c001-4d4e-838b-265222ee2269 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:08.897893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6aa9edd7-c001-4d4e-838b-265222ee2269 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:08.897893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6aa9edd7-c001-4d4e-838b-265222ee2269 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:08.897893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6aa9edd7-c001-4d4e-838b-265222ee2269 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:08.898245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6aa9edd7-c001-4d4e-838b-265222ee2269 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:08.898245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6aa9edd7-c001-4d4e-838b-265222ee2269 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:08.898706 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6aa9edd7-c001-4d4e-838b-265222ee2269 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:09.133590 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6aa9edd7-c001-4d4e-838b-265222ee2269 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:09.141646 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6aa9edd7-c001-4d4e-838b-265222ee2269 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.259187 Sep 16 08:06:09.142711 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 76/136] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:08 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:09.578045 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ce32dbbf-0382-4b34-baf6-9dfacd14ef89 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:09.578717 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ce32dbbf-0382-4b34-baf6-9dfacd14ef89 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:09.585156 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ce32dbbf-0382-4b34-baf6-9dfacd14ef89 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:09.585828 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ce32dbbf-0382-4b34-baf6-9dfacd14ef89 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:09.586427 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ce32dbbf-0382-4b34-baf6-9dfacd14ef89 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:09.587154 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ce32dbbf-0382-4b34-baf6-9dfacd14ef89 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:09.587843 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ce32dbbf-0382-4b34-baf6-9dfacd14ef89 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:09.588407 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ce32dbbf-0382-4b34-baf6-9dfacd14ef89 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:09.666165 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-05c3d297-961a-4277-b845-0cf75055ca0e req-feb75721-085a-4fb4-989a-c673e1bc0717 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "547e4d8b-02bd-4033-82b3-04db0ba60fe5", "tag": "047136d4-f91b-4e74-bfe8-7505cf1c706e"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:06:09.687180 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-05c3d297-961a-4277-b845-0cf75055ca0e req-feb75721-085a-4fb4-989a-c673e1bc0717 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:09.687654 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-05c3d297-961a-4277-b845-0cf75055ca0e req-feb75721-085a-4fb4-989a-c673e1bc0717 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:09.688107 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-05c3d297-961a-4277-b845-0cf75055ca0e req-feb75721-085a-4fb4-989a-c673e1bc0717 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:09.717540 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-05c3d297-961a-4277-b845-0cf75055ca0e req-feb75721-085a-4fb4-989a-c673e1bc0717 service nova] Creating event network-changed:047136d4-f91b-4e74-bfe8-7505cf1c706e for instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 on hv-cinder-74014 Sep 16 08:06:09.734467 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-05c3d297-961a-4277-b845-0cf75055ca0e req-feb75721-085a-4fb4-989a-c673e1bc0717 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.071717 Sep 16 08:06:09.747031 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 77/137] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:06:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:06:09.820136 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ce32dbbf-0382-4b34-baf6-9dfacd14ef89 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:09.828266 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ce32dbbf-0382-4b34-baf6-9dfacd14ef89 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.253993 Sep 16 08:06:09.843547 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 61/138] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:09 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 270 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:10.168153 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-468b571d-2250-4291-9546-355f9ee87369 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:10.169362 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-468b571d-2250-4291-9546-355f9ee87369 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:10.173138 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:10.178414 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-468b571d-2250-4291-9546-355f9ee87369 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:10.179144 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-468b571d-2250-4291-9546-355f9ee87369 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:10.180039 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-468b571d-2250-4291-9546-355f9ee87369 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:10.180953 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-468b571d-2250-4291-9546-355f9ee87369 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:10.181664 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-468b571d-2250-4291-9546-355f9ee87369 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:10.182298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-468b571d-2250-4291-9546-355f9ee87369 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:10.338189 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-468b571d-2250-4291-9546-355f9ee87369 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:10.347574 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-468b571d-2250-4291-9546-355f9ee87369 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.185176 Sep 16 08:06:10.350329 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 78/139] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:10 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:10.852351 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3b9b138f-8181-408c-9de3-c9bb02dc603c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:10.852961 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3b9b138f-8181-408c-9de3-c9bb02dc603c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:10.865533 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b9b138f-8181-408c-9de3-c9bb02dc603c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:10.865533 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b9b138f-8181-408c-9de3-c9bb02dc603c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:10.865533 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b9b138f-8181-408c-9de3-c9bb02dc603c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:10.865533 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b9b138f-8181-408c-9de3-c9bb02dc603c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:10.865965 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b9b138f-8181-408c-9de3-c9bb02dc603c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:10.865965 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b9b138f-8181-408c-9de3-c9bb02dc603c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:11.083016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3b9b138f-8181-408c-9de3-c9bb02dc603c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:11.092320 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3b9b138f-8181-408c-9de3-c9bb02dc603c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.243778 Sep 16 08:06:11.093126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 62/140] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:10 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:11.377572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d0f794c5-8964-4f62-a4ca-7ddc73abbd38 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:11.377572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d0f794c5-8964-4f62-a4ca-7ddc73abbd38 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:11.381076 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d0f794c5-8964-4f62-a4ca-7ddc73abbd38 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:11.381784 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d0f794c5-8964-4f62-a4ca-7ddc73abbd38 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:11.382433 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d0f794c5-8964-4f62-a4ca-7ddc73abbd38 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:11.383440 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d0f794c5-8964-4f62-a4ca-7ddc73abbd38 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:11.384131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d0f794c5-8964-4f62-a4ca-7ddc73abbd38 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:11.384702 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d0f794c5-8964-4f62-a4ca-7ddc73abbd38 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:11.550251 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d0f794c5-8964-4f62-a4ca-7ddc73abbd38 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:11.574093 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d0f794c5-8964-4f62-a4ca-7ddc73abbd38 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.205331 Sep 16 08:06:11.576285 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 79/141] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:11 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:11.623974 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e0557310-e892-4313-81ae-6e5c20e02289 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "1fce767e-64a7-4793-8faa-9d8dbb47282f"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:06:11.626632 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e0557310-e892-4313-81ae-6e5c20e02289 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:11.632798 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e0557310-e892-4313-81ae-6e5c20e02289 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:11.633221 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e0557310-e892-4313-81ae-6e5c20e02289 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:11.633652 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e0557310-e892-4313-81ae-6e5c20e02289 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:11.634346 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e0557310-e892-4313-81ae-6e5c20e02289 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:11.634823 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e0557310-e892-4313-81ae-6e5c20e02289 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:11.635246 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e0557310-e892-4313-81ae-6e5c20e02289 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:11.853567 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:12.124722 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f9fc3e78-99b3-4fd8-98f3-6c20b7c181dd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:12.127104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f9fc3e78-99b3-4fd8-98f3-6c20b7c181dd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:12.137626 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f9fc3e78-99b3-4fd8-98f3-6c20b7c181dd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:12.139740 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f9fc3e78-99b3-4fd8-98f3-6c20b7c181dd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:12.142236 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f9fc3e78-99b3-4fd8-98f3-6c20b7c181dd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:12.143133 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f9fc3e78-99b3-4fd8-98f3-6c20b7c181dd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:12.144246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f9fc3e78-99b3-4fd8-98f3-6c20b7c181dd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:12.145444 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f9fc3e78-99b3-4fd8-98f3-6c20b7c181dd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:12.360224 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f9fc3e78-99b3-4fd8-98f3-6c20b7c181dd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:12.378544 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f9fc3e78-99b3-4fd8-98f3-6c20b7c181dd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.260386 Sep 16 08:06:12.378544 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 80/142] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:12 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:12.599817 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cbf0b903-5d0c-4078-92fb-ad5392a9d7a8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:12.600417 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cbf0b903-5d0c-4078-92fb-ad5392a9d7a8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:12.606527 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cbf0b903-5d0c-4078-92fb-ad5392a9d7a8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:12.607073 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cbf0b903-5d0c-4078-92fb-ad5392a9d7a8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:12.607507 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cbf0b903-5d0c-4078-92fb-ad5392a9d7a8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:12.608193 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cbf0b903-5d0c-4078-92fb-ad5392a9d7a8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:12.608639 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cbf0b903-5d0c-4078-92fb-ad5392a9d7a8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:12.609057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cbf0b903-5d0c-4078-92fb-ad5392a9d7a8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:12.768273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cbf0b903-5d0c-4078-92fb-ad5392a9d7a8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:12.773504 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e0557310-e892-4313-81ae-6e5c20e02289 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "POST /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.153350 Sep 16 08:06:12.777487 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 63/143] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:06:11 2022] POST /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86/os-volume_attachments => generated 194 bytes in 1155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:06:12.777630 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cbf0b903-5d0c-4078-92fb-ad5392a9d7a8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.181688 Sep 16 08:06:12.785872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 81/144] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:12 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:06:13.414647 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-afd6facc-3cf8-41e3-a1bd-21b459fbeaca tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:13.414647 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-afd6facc-3cf8-41e3-a1bd-21b459fbeaca tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:13.415919 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-afd6facc-3cf8-41e3-a1bd-21b459fbeaca tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:13.417117 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-afd6facc-3cf8-41e3-a1bd-21b459fbeaca tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:13.417669 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-afd6facc-3cf8-41e3-a1bd-21b459fbeaca tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:13.419781 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-afd6facc-3cf8-41e3-a1bd-21b459fbeaca tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:13.420961 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-afd6facc-3cf8-41e3-a1bd-21b459fbeaca tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:13.421502 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-afd6facc-3cf8-41e3-a1bd-21b459fbeaca tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:13.426897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:13.572085 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-afd6facc-3cf8-41e3-a1bd-21b459fbeaca tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:13.582321 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-afd6facc-3cf8-41e3-a1bd-21b459fbeaca tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1361 microversion: 2.1 time: 0.184343 Sep 16 08:06:13.583312 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 64/145] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:13 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1361 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:13.799457 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f8199c2d-a052-4499-a671-bb9895a4aa83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:13.800066 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f8199c2d-a052-4499-a671-bb9895a4aa83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:13.806867 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f8199c2d-a052-4499-a671-bb9895a4aa83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:13.807354 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f8199c2d-a052-4499-a671-bb9895a4aa83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:13.807792 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f8199c2d-a052-4499-a671-bb9895a4aa83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:13.808481 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f8199c2d-a052-4499-a671-bb9895a4aa83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:13.808933 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f8199c2d-a052-4499-a671-bb9895a4aa83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:13.809358 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f8199c2d-a052-4499-a671-bb9895a4aa83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:14.065365 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f8199c2d-a052-4499-a671-bb9895a4aa83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:14.081939 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f8199c2d-a052-4499-a671-bb9895a4aa83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1321 microversion: 2.1 time: 0.286166 Sep 16 08:06:14.095299 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 82/146] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:13 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1321 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:06:14.605772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b2bb7e74-5268-4848-bf49-ec0452802822 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:14.606385 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b2bb7e74-5268-4848-bf49-ec0452802822 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:14.613613 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2bb7e74-5268-4848-bf49-ec0452802822 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:14.614594 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2bb7e74-5268-4848-bf49-ec0452802822 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:14.615068 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2bb7e74-5268-4848-bf49-ec0452802822 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:14.615771 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2bb7e74-5268-4848-bf49-ec0452802822 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:14.616234 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2bb7e74-5268-4848-bf49-ec0452802822 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:14.616670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2bb7e74-5268-4848-bf49-ec0452802822 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:14.802652 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b2bb7e74-5268-4848-bf49-ec0452802822 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:14.810507 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b2bb7e74-5268-4848-bf49-ec0452802822 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1547 microversion: 2.1 time: 0.208553 Sep 16 08:06:14.811141 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 65/147] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:14 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1547 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:14.838442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-06c1fa86-64c5-4ff8-b9ab-eebbbea37ded tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:14.838996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-06c1fa86-64c5-4ff8-b9ab-eebbbea37ded tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:14.844961 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-06c1fa86-64c5-4ff8-b9ab-eebbbea37ded tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:14.845443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-06c1fa86-64c5-4ff8-b9ab-eebbbea37ded tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:14.845890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-06c1fa86-64c5-4ff8-b9ab-eebbbea37ded tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:14.846578 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-06c1fa86-64c5-4ff8-b9ab-eebbbea37ded tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:14.847067 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-06c1fa86-64c5-4ff8-b9ab-eebbbea37ded tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:14.847495 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-06c1fa86-64c5-4ff8-b9ab-eebbbea37ded tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:14.986229 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-06c1fa86-64c5-4ff8-b9ab-eebbbea37ded tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.151606 Sep 16 08:06:14.986998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 83/148] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Sep 16 08:06:14 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/os-interface => generated 284 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:06:15.107486 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-22e806ea-df7f-45ca-88fc-26faed4d0fde tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:15.108105 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-22e806ea-df7f-45ca-88fc-26faed4d0fde tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:15.123167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=83 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:15.123167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22e806ea-df7f-45ca-88fc-26faed4d0fde tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:15.123167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22e806ea-df7f-45ca-88fc-26faed4d0fde tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:15.123588 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22e806ea-df7f-45ca-88fc-26faed4d0fde tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:15.124480 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22e806ea-df7f-45ca-88fc-26faed4d0fde tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:15.125085 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22e806ea-df7f-45ca-88fc-26faed4d0fde tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:15.125650 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22e806ea-df7f-45ca-88fc-26faed4d0fde tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:15.565913 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-22e806ea-df7f-45ca-88fc-26faed4d0fde tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:15.574350 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-22e806ea-df7f-45ca-88fc-26faed4d0fde tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1515 microversion: 2.1 time: 0.472651 Sep 16 08:06:15.574961 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 66/149] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:15 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1515 bytes in 474 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:15.597499 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ade10f59-b839-446d-92ad-278686cf2bfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:06:15.600025 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ade10f59-b839-446d-92ad-278686cf2bfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:15.606875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ade10f59-b839-446d-92ad-278686cf2bfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:15.607654 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ade10f59-b839-446d-92ad-278686cf2bfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:15.608341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ade10f59-b839-446d-92ad-278686cf2bfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:15.609439 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ade10f59-b839-446d-92ad-278686cf2bfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:15.610093 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ade10f59-b839-446d-92ad-278686cf2bfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:15.610757 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ade10f59-b839-446d-92ad-278686cf2bfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:15.638466 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-ade10f59-b839-446d-92ad-278686cf2bfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lazy-loading 'flavor' on Instance uuid d6ed2e44-f810-44fb-96f8-50847e08026e {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:06:15.928854 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:16.106828 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ade10f59-b839-446d-92ad-278686cf2bfc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "POST /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e/action" status: 200 len: 32 microversion: 2.1 time: 0.510992 Sep 16 08:06:16.106828 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 84/150] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:06:15 2022] POST /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e/action => generated 32 bytes in 512 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 08:06:16.115236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f126f012-8344-4a43-b7d1-01fd741d4df8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:16.116426 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f126f012-8344-4a43-b7d1-01fd741d4df8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:16.125639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f126f012-8344-4a43-b7d1-01fd741d4df8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:16.126842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f126f012-8344-4a43-b7d1-01fd741d4df8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:16.127446 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f126f012-8344-4a43-b7d1-01fd741d4df8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:16.128323 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f126f012-8344-4a43-b7d1-01fd741d4df8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:16.135391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f126f012-8344-4a43-b7d1-01fd741d4df8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:16.135391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f126f012-8344-4a43-b7d1-01fd741d4df8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:16.487063 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f126f012-8344-4a43-b7d1-01fd741d4df8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:16.487063 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f126f012-8344-4a43-b7d1-01fd741d4df8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.351351 Sep 16 08:06:16.487063 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 67/151] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:16 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 353 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:17.156529 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-3250a991-8ca9-426e-8bd0-5d5ca15ecde4 req-1346b1e6-f126-456a-a105-b1c0f229c497 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe69a551-c89a-4b4f-a026-5e23f39a1355", "tag": "8a64e1a8-08fe-42cc-84de-a5e3362d89fc"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:06:17.166314 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-3250a991-8ca9-426e-8bd0-5d5ca15ecde4 req-1346b1e6-f126-456a-a105-b1c0f229c497 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:17.167065 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-3250a991-8ca9-426e-8bd0-5d5ca15ecde4 req-1346b1e6-f126-456a-a105-b1c0f229c497 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:17.167500 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-3250a991-8ca9-426e-8bd0-5d5ca15ecde4 req-1346b1e6-f126-456a-a105-b1c0f229c497 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:17.188841 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-3250a991-8ca9-426e-8bd0-5d5ca15ecde4 req-1346b1e6-f126-456a-a105-b1c0f229c497 service nova] Creating event network-changed:8a64e1a8-08fe-42cc-84de-a5e3362d89fc for instance fe69a551-c89a-4b4f-a026-5e23f39a1355 on hv-cinder-74014 Sep 16 08:06:17.194575 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-3250a991-8ca9-426e-8bd0-5d5ca15ecde4 req-1346b1e6-f126-456a-a105-b1c0f229c497 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041976 Sep 16 08:06:17.195399 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 85/152] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:06:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:06:17.511444 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d05a385d-b73c-4cbd-9107-7dec059954cf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:17.513741 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d05a385d-b73c-4cbd-9107-7dec059954cf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:17.523622 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d05a385d-b73c-4cbd-9107-7dec059954cf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:17.524629 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d05a385d-b73c-4cbd-9107-7dec059954cf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:17.525395 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d05a385d-b73c-4cbd-9107-7dec059954cf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:17.526978 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d05a385d-b73c-4cbd-9107-7dec059954cf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:17.527693 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d05a385d-b73c-4cbd-9107-7dec059954cf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:17.528595 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d05a385d-b73c-4cbd-9107-7dec059954cf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:17.756917 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d05a385d-b73c-4cbd-9107-7dec059954cf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:17.769029 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d05a385d-b73c-4cbd-9107-7dec059954cf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.264682 Sep 16 08:06:17.771030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 68/153] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:17 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:18.805747 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-75a98394-e707-427d-8980-01f0e0c0860e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:18.806436 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-75a98394-e707-427d-8980-01f0e0c0860e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:18.813053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-75a98394-e707-427d-8980-01f0e0c0860e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:18.813529 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-75a98394-e707-427d-8980-01f0e0c0860e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:18.813959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-75a98394-e707-427d-8980-01f0e0c0860e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:18.814644 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-75a98394-e707-427d-8980-01f0e0c0860e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:18.815127 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-75a98394-e707-427d-8980-01f0e0c0860e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:18.815544 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-75a98394-e707-427d-8980-01f0e0c0860e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:18.964910 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-75a98394-e707-427d-8980-01f0e0c0860e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:18.972573 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-75a98394-e707-427d-8980-01f0e0c0860e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.172096 Sep 16 08:06:18.973177 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 86/154] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:18 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:20.005765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6bc3a4f8-c28b-4c15-9d5e-ee4cdbc17c43 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:20.005765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6bc3a4f8-c28b-4c15-9d5e-ee4cdbc17c43 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:20.005765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6bc3a4f8-c28b-4c15-9d5e-ee4cdbc17c43 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:20.005765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6bc3a4f8-c28b-4c15-9d5e-ee4cdbc17c43 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:20.006477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6bc3a4f8-c28b-4c15-9d5e-ee4cdbc17c43 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:20.006477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6bc3a4f8-c28b-4c15-9d5e-ee4cdbc17c43 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:20.006477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6bc3a4f8-c28b-4c15-9d5e-ee4cdbc17c43 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:20.006732 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6bc3a4f8-c28b-4c15-9d5e-ee4cdbc17c43 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:20.149781 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6bc3a4f8-c28b-4c15-9d5e-ee4cdbc17c43 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:20.157457 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6bc3a4f8-c28b-4c15-9d5e-ee4cdbc17c43 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.165176 Sep 16 08:06:20.158029 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 69/155] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:19 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:21.180530 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2e03b79c-2c1f-4bd4-8d7f-2490d14c64b7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:21.181706 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2e03b79c-2c1f-4bd4-8d7f-2490d14c64b7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:21.188021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2e03b79c-2c1f-4bd4-8d7f-2490d14c64b7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:21.192354 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2e03b79c-2c1f-4bd4-8d7f-2490d14c64b7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:21.192354 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2e03b79c-2c1f-4bd4-8d7f-2490d14c64b7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:21.192354 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2e03b79c-2c1f-4bd4-8d7f-2490d14c64b7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:21.192354 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2e03b79c-2c1f-4bd4-8d7f-2490d14c64b7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:21.192840 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2e03b79c-2c1f-4bd4-8d7f-2490d14c64b7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:21.367792 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2e03b79c-2c1f-4bd4-8d7f-2490d14c64b7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:21.375779 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2e03b79c-2c1f-4bd4-8d7f-2490d14c64b7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.199211 Sep 16 08:06:21.376360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 87/156] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:21 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:22.399334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-12e87097-cc5b-4c78-a34b-99adbbd05d00 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:22.402283 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-12e87097-cc5b-4c78-a34b-99adbbd05d00 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:22.407745 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-12e87097-cc5b-4c78-a34b-99adbbd05d00 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:22.407745 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-12e87097-cc5b-4c78-a34b-99adbbd05d00 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:22.407918 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-12e87097-cc5b-4c78-a34b-99adbbd05d00 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:22.408644 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-12e87097-cc5b-4c78-a34b-99adbbd05d00 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:22.409092 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-12e87097-cc5b-4c78-a34b-99adbbd05d00 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:22.410064 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-12e87097-cc5b-4c78-a34b-99adbbd05d00 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:22.571283 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-12e87097-cc5b-4c78-a34b-99adbbd05d00 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:22.578972 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-12e87097-cc5b-4c78-a34b-99adbbd05d00 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.183975 Sep 16 08:06:22.579541 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 70/157] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:22 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:23.603030 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6d11003a-d72d-4991-b651-b397acdd9599 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:23.603685 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6d11003a-d72d-4991-b651-b397acdd9599 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:23.610050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d11003a-d72d-4991-b651-b397acdd9599 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:23.610555 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d11003a-d72d-4991-b651-b397acdd9599 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:23.611058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d11003a-d72d-4991-b651-b397acdd9599 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:23.611868 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d11003a-d72d-4991-b651-b397acdd9599 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:23.612191 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d11003a-d72d-4991-b651-b397acdd9599 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:23.612611 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d11003a-d72d-4991-b651-b397acdd9599 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:23.750887 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6d11003a-d72d-4991-b651-b397acdd9599 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:23.759738 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6d11003a-d72d-4991-b651-b397acdd9599 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.161064 Sep 16 08:06:23.760332 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 88/158] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:23 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:24.783308 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-04225e8e-710d-4887-a3f7-a7a56dfb897f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:24.783981 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-04225e8e-710d-4887-a3f7-a7a56dfb897f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:24.790746 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-04225e8e-710d-4887-a3f7-a7a56dfb897f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:24.791482 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-04225e8e-710d-4887-a3f7-a7a56dfb897f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:24.792150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-04225e8e-710d-4887-a3f7-a7a56dfb897f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:24.793248 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-04225e8e-710d-4887-a3f7-a7a56dfb897f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:24.793989 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-04225e8e-710d-4887-a3f7-a7a56dfb897f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:24.794605 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-04225e8e-710d-4887-a3f7-a7a56dfb897f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:24.936555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-04225e8e-710d-4887-a3f7-a7a56dfb897f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:24.945330 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-04225e8e-710d-4887-a3f7-a7a56dfb897f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.165960 Sep 16 08:06:24.953323 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 71/159] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:24 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:25.977509 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dc50fc15-1163-4def-bd07-edef7f635148 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:25.978058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dc50fc15-1163-4def-bd07-edef7f635148 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:25.984197 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc50fc15-1163-4def-bd07-edef7f635148 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:25.985600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc50fc15-1163-4def-bd07-edef7f635148 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:25.985600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc50fc15-1163-4def-bd07-edef7f635148 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:25.985807 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc50fc15-1163-4def-bd07-edef7f635148 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:25.986207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc50fc15-1163-4def-bd07-edef7f635148 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:25.986632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc50fc15-1163-4def-bd07-edef7f635148 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:26.114386 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dc50fc15-1163-4def-bd07-edef7f635148 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:26.122287 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dc50fc15-1163-4def-bd07-edef7f635148 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.148736 Sep 16 08:06:26.122878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 89/160] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:25 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:27.078961 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5620b458-4d1d-4e70-9c73-c8e3b22829ad tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:27.079441 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5620b458-4d1d-4e70-9c73-c8e3b22829ad tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:27.086333 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5620b458-4d1d-4e70-9c73-c8e3b22829ad tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:27.088055 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5620b458-4d1d-4e70-9c73-c8e3b22829ad tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:27.088055 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5620b458-4d1d-4e70-9c73-c8e3b22829ad tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:27.088055 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5620b458-4d1d-4e70-9c73-c8e3b22829ad tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:27.088627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5620b458-4d1d-4e70-9c73-c8e3b22829ad tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:27.089050 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5620b458-4d1d-4e70-9c73-c8e3b22829ad tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:27.115548 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5620b458-4d1d-4e70-9c73-c8e3b22829ad tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Going to try to terminate instance {{(pid=121047) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:06:27.146139 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-42a889ad-d4d5-460c-bd13-cbcb6cfa1e26 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:27.147189 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-42a889ad-d4d5-460c-bd13-cbcb6cfa1e26 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:27.154168 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-42a889ad-d4d5-460c-bd13-cbcb6cfa1e26 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:27.154648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-42a889ad-d4d5-460c-bd13-cbcb6cfa1e26 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:27.155115 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-42a889ad-d4d5-460c-bd13-cbcb6cfa1e26 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:27.155806 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-42a889ad-d4d5-460c-bd13-cbcb6cfa1e26 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:27.156258 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-42a889ad-d4d5-460c-bd13-cbcb6cfa1e26 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:27.156800 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-42a889ad-d4d5-460c-bd13-cbcb6cfa1e26 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:27.288380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-42a889ad-d4d5-460c-bd13-cbcb6cfa1e26 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:27.296053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-42a889ad-d4d5-460c-bd13-cbcb6cfa1e26 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.154801 Sep 16 08:06:27.296615 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 90/161] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:27 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:27.454018 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5620b458-4d1d-4e70-9c73-c8e3b22829ad tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 204 len: 0 microversion: 2.1 time: 0.378546 Sep 16 08:06:27.454614 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 72/162] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:06:27 2022] DELETE /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 0 bytes in 380 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:06:27.463457 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-604ffa80-e3ac-4561-9344-e2092d7239be tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:27.464064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-604ffa80-e3ac-4561-9344-e2092d7239be tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:27.469968 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-604ffa80-e3ac-4561-9344-e2092d7239be tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:27.470450 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-604ffa80-e3ac-4561-9344-e2092d7239be tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:27.470927 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-604ffa80-e3ac-4561-9344-e2092d7239be tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:27.471653 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-604ffa80-e3ac-4561-9344-e2092d7239be tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:27.472109 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-604ffa80-e3ac-4561-9344-e2092d7239be tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:27.472535 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-604ffa80-e3ac-4561-9344-e2092d7239be tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:27.601426 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-604ffa80-e3ac-4561-9344-e2092d7239be tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:27.609621 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-604ffa80-e3ac-4561-9344-e2092d7239be tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1555 microversion: 2.1 time: 0.150056 Sep 16 08:06:27.610177 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 91/163] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:27 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:28.318363 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-13415980-d2ec-477a-8ee6-f08c815e25e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:28.319100 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-13415980-d2ec-477a-8ee6-f08c815e25e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:28.326182 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-13415980-d2ec-477a-8ee6-f08c815e25e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:28.326664 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-13415980-d2ec-477a-8ee6-f08c815e25e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:28.327127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-13415980-d2ec-477a-8ee6-f08c815e25e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:28.327814 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-13415980-d2ec-477a-8ee6-f08c815e25e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:28.328271 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-13415980-d2ec-477a-8ee6-f08c815e25e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:28.328701 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-13415980-d2ec-477a-8ee6-f08c815e25e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:28.454426 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-13415980-d2ec-477a-8ee6-f08c815e25e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:28.462046 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-13415980-d2ec-477a-8ee6-f08c815e25e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.147902 Sep 16 08:06:28.462611 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 73/164] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:28 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:28.632591 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-423de3cf-7d7b-4ee2-9e74-8c87dd009945 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:28.633194 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-423de3cf-7d7b-4ee2-9e74-8c87dd009945 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:28.639302 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-423de3cf-7d7b-4ee2-9e74-8c87dd009945 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:28.639773 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-423de3cf-7d7b-4ee2-9e74-8c87dd009945 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:28.640199 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-423de3cf-7d7b-4ee2-9e74-8c87dd009945 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:28.640896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-423de3cf-7d7b-4ee2-9e74-8c87dd009945 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:28.641342 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-423de3cf-7d7b-4ee2-9e74-8c87dd009945 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:28.641757 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-423de3cf-7d7b-4ee2-9e74-8c87dd009945 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:28.771911 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-423de3cf-7d7b-4ee2-9e74-8c87dd009945 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:28.780131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-423de3cf-7d7b-4ee2-9e74-8c87dd009945 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1555 microversion: 2.1 time: 0.151333 Sep 16 08:06:28.780742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 92/165] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:28 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:29.485068 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4d5e7be2-a53c-4115-9a16-c3bdc9ece57a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:29.485676 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4d5e7be2-a53c-4115-9a16-c3bdc9ece57a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:29.492664 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d5e7be2-a53c-4115-9a16-c3bdc9ece57a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:29.493149 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d5e7be2-a53c-4115-9a16-c3bdc9ece57a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:29.493589 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d5e7be2-a53c-4115-9a16-c3bdc9ece57a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:29.494280 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d5e7be2-a53c-4115-9a16-c3bdc9ece57a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:29.494757 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d5e7be2-a53c-4115-9a16-c3bdc9ece57a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:29.495187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d5e7be2-a53c-4115-9a16-c3bdc9ece57a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:29.621689 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-4d5e7be2-a53c-4115-9a16-c3bdc9ece57a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:29.629387 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4d5e7be2-a53c-4115-9a16-c3bdc9ece57a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.148181 Sep 16 08:06:29.630617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 74/166] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:29 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:29.804596 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7a2bf80c-7ba7-4b26-a1c0-a752e1334b7a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:29.805206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7a2bf80c-7ba7-4b26-a1c0-a752e1334b7a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:29.811181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a2bf80c-7ba7-4b26-a1c0-a752e1334b7a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:29.811660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a2bf80c-7ba7-4b26-a1c0-a752e1334b7a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:29.812095 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a2bf80c-7ba7-4b26-a1c0-a752e1334b7a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:29.812837 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a2bf80c-7ba7-4b26-a1c0-a752e1334b7a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:29.813294 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a2bf80c-7ba7-4b26-a1c0-a752e1334b7a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:29.813720 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a2bf80c-7ba7-4b26-a1c0-a752e1334b7a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:29.941083 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7a2bf80c-7ba7-4b26-a1c0-a752e1334b7a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:29.964427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7a2bf80c-7ba7-4b26-a1c0-a752e1334b7a tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1555 microversion: 2.1 time: 0.164254 Sep 16 08:06:29.965104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 93/167] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:29 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1555 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:30.653017 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c59235e8-fa84-4cbf-a783-bd0a4694a558 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:30.653621 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c59235e8-fa84-4cbf-a783-bd0a4694a558 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:30.660413 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c59235e8-fa84-4cbf-a783-bd0a4694a558 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:30.660884 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c59235e8-fa84-4cbf-a783-bd0a4694a558 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:30.661313 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c59235e8-fa84-4cbf-a783-bd0a4694a558 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:30.661991 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c59235e8-fa84-4cbf-a783-bd0a4694a558 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:30.662955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c59235e8-fa84-4cbf-a783-bd0a4694a558 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:30.662955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c59235e8-fa84-4cbf-a783-bd0a4694a558 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:30.793349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c59235e8-fa84-4cbf-a783-bd0a4694a558 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:30.801259 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c59235e8-fa84-4cbf-a783-bd0a4694a558 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.152072 Sep 16 08:06:30.802488 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 75/168] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:30 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:30.987988 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6d49ac4f-4e8d-4406-b8e2-733c37bc4c02 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:30.988599 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6d49ac4f-4e8d-4406-b8e2-733c37bc4c02 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:30.999453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d49ac4f-4e8d-4406-b8e2-733c37bc4c02 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:30.999795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d49ac4f-4e8d-4406-b8e2-733c37bc4c02 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:31.000228 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d49ac4f-4e8d-4406-b8e2-733c37bc4c02 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:31.001059 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d49ac4f-4e8d-4406-b8e2-733c37bc4c02 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:31.001519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d49ac4f-4e8d-4406-b8e2-733c37bc4c02 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:31.001940 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d49ac4f-4e8d-4406-b8e2-733c37bc4c02 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:31.129040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6d49ac4f-4e8d-4406-b8e2-733c37bc4c02 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:31.137820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6d49ac4f-4e8d-4406-b8e2-733c37bc4c02 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1555 microversion: 2.1 time: 0.153853 Sep 16 08:06:31.138386 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 94/169] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:30 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1555 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:31.825508 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0036d99e-4a2f-44e1-88e8-3c2a1a1ad1ea tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:31.826122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0036d99e-4a2f-44e1-88e8-3c2a1a1ad1ea tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:31.833119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0036d99e-4a2f-44e1-88e8-3c2a1a1ad1ea tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:31.833606 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0036d99e-4a2f-44e1-88e8-3c2a1a1ad1ea tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:31.834053 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0036d99e-4a2f-44e1-88e8-3c2a1a1ad1ea tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:31.834773 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0036d99e-4a2f-44e1-88e8-3c2a1a1ad1ea tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:31.835235 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0036d99e-4a2f-44e1-88e8-3c2a1a1ad1ea tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:31.835669 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0036d99e-4a2f-44e1-88e8-3c2a1a1ad1ea tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:31.961858 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0036d99e-4a2f-44e1-88e8-3c2a1a1ad1ea tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:31.969813 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0036d99e-4a2f-44e1-88e8-3c2a1a1ad1ea tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.148180 Sep 16 08:06:31.970392 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 76/170] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:31 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:32.160626 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6b10092a-99cc-4b67-9d67-16aba1dc3d9b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:32.161262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6b10092a-99cc-4b67-9d67-16aba1dc3d9b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:32.167214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6b10092a-99cc-4b67-9d67-16aba1dc3d9b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:32.167632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6b10092a-99cc-4b67-9d67-16aba1dc3d9b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:32.168076 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6b10092a-99cc-4b67-9d67-16aba1dc3d9b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:32.168790 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6b10092a-99cc-4b67-9d67-16aba1dc3d9b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:32.169246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6b10092a-99cc-4b67-9d67-16aba1dc3d9b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:32.169669 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6b10092a-99cc-4b67-9d67-16aba1dc3d9b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:32.298042 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6b10092a-99cc-4b67-9d67-16aba1dc3d9b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:32.306188 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6b10092a-99cc-4b67-9d67-16aba1dc3d9b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1555 microversion: 2.1 time: 0.149586 Sep 16 08:06:32.306769 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 95/171] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:32 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1555 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:32.994361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1aa8e5a6-a7b7-4be2-ab40-eaba3a463f78 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:32.995048 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1aa8e5a6-a7b7-4be2-ab40-eaba3a463f78 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:33.001750 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1aa8e5a6-a7b7-4be2-ab40-eaba3a463f78 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:33.002234 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1aa8e5a6-a7b7-4be2-ab40-eaba3a463f78 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:33.002667 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1aa8e5a6-a7b7-4be2-ab40-eaba3a463f78 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:33.003375 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1aa8e5a6-a7b7-4be2-ab40-eaba3a463f78 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:33.003908 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1aa8e5a6-a7b7-4be2-ab40-eaba3a463f78 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:33.004983 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1aa8e5a6-a7b7-4be2-ab40-eaba3a463f78 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:33.134852 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1aa8e5a6-a7b7-4be2-ab40-eaba3a463f78 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:33.143358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1aa8e5a6-a7b7-4be2-ab40-eaba3a463f78 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.153375 Sep 16 08:06:33.143915 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 77/172] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:32 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:33.328793 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-01efff2f-4644-4d62-9541-7d700448f417 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:33.329394 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-01efff2f-4644-4d62-9541-7d700448f417 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:33.336747 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-01efff2f-4644-4d62-9541-7d700448f417 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:33.337340 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-01efff2f-4644-4d62-9541-7d700448f417 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:33.337814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-01efff2f-4644-4d62-9541-7d700448f417 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:33.338515 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-01efff2f-4644-4d62-9541-7d700448f417 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:33.339011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-01efff2f-4644-4d62-9541-7d700448f417 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:33.339557 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-01efff2f-4644-4d62-9541-7d700448f417 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:33.467278 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-01efff2f-4644-4d62-9541-7d700448f417 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:33.476069 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-01efff2f-4644-4d62-9541-7d700448f417 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1555 microversion: 2.1 time: 0.151231 Sep 16 08:06:33.476777 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 96/173] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:33 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1555 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:34.166606 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d0517489-d411-4aa1-90cb-dc6c755ae066 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:34.167250 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d0517489-d411-4aa1-90cb-dc6c755ae066 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:34.177835 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d0517489-d411-4aa1-90cb-dc6c755ae066 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:34.178374 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d0517489-d411-4aa1-90cb-dc6c755ae066 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:34.179208 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d0517489-d411-4aa1-90cb-dc6c755ae066 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:34.179633 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d0517489-d411-4aa1-90cb-dc6c755ae066 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:34.180092 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d0517489-d411-4aa1-90cb-dc6c755ae066 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:34.180521 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d0517489-d411-4aa1-90cb-dc6c755ae066 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:34.313756 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d0517489-d411-4aa1-90cb-dc6c755ae066 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:34.328745 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d0517489-d411-4aa1-90cb-dc6c755ae066 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.159881 Sep 16 08:06:34.328745 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 78/174] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:34 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:34.498885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3bd260ef-7c48-480d-b410-6f7574f1edc0 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:34.501050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3bd260ef-7c48-480d-b410-6f7574f1edc0 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:34.506181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bd260ef-7c48-480d-b410-6f7574f1edc0 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:34.506722 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bd260ef-7c48-480d-b410-6f7574f1edc0 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:34.507159 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bd260ef-7c48-480d-b410-6f7574f1edc0 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:34.507832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bd260ef-7c48-480d-b410-6f7574f1edc0 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:34.508282 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bd260ef-7c48-480d-b410-6f7574f1edc0 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:34.508699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bd260ef-7c48-480d-b410-6f7574f1edc0 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:34.650383 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3bd260ef-7c48-480d-b410-6f7574f1edc0 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:34.659333 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3bd260ef-7c48-480d-b410-6f7574f1edc0 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1555 microversion: 2.1 time: 0.163924 Sep 16 08:06:34.659916 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 97/175] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:34 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1555 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:35.350798 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-731fd82c-73f1-411a-b03e-d90c6ff4dc5f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:35.351343 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-731fd82c-73f1-411a-b03e-d90c6ff4dc5f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:35.357630 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-731fd82c-73f1-411a-b03e-d90c6ff4dc5f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:35.358118 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-731fd82c-73f1-411a-b03e-d90c6ff4dc5f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:35.358558 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-731fd82c-73f1-411a-b03e-d90c6ff4dc5f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:35.359275 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-731fd82c-73f1-411a-b03e-d90c6ff4dc5f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:35.359731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-731fd82c-73f1-411a-b03e-d90c6ff4dc5f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:35.360161 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-731fd82c-73f1-411a-b03e-d90c6ff4dc5f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:35.364256 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:35.484971 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-731fd82c-73f1-411a-b03e-d90c6ff4dc5f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:35.492623 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-731fd82c-73f1-411a-b03e-d90c6ff4dc5f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.146342 Sep 16 08:06:35.493184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 79/176] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:35 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:35.681667 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ba27c027-751f-416b-8704-1e0d96878a59 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:35.682272 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ba27c027-751f-416b-8704-1e0d96878a59 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:35.688192 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ba27c027-751f-416b-8704-1e0d96878a59 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:35.688674 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ba27c027-751f-416b-8704-1e0d96878a59 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:35.689101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ba27c027-751f-416b-8704-1e0d96878a59 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:35.689775 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ba27c027-751f-416b-8704-1e0d96878a59 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:35.690223 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ba27c027-751f-416b-8704-1e0d96878a59 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:35.690643 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ba27c027-751f-416b-8704-1e0d96878a59 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:35.813928 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ba27c027-751f-416b-8704-1e0d96878a59 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:35.822488 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ba27c027-751f-416b-8704-1e0d96878a59 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1555 microversion: 2.1 time: 0.144578 Sep 16 08:06:35.823091 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 98/177] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:35 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1555 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:36.515516 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-85ecad8a-bb62-484c-b7a2-0e1188e94594 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:36.516113 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-85ecad8a-bb62-484c-b7a2-0e1188e94594 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:36.522572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-85ecad8a-bb62-484c-b7a2-0e1188e94594 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:36.523088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-85ecad8a-bb62-484c-b7a2-0e1188e94594 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:36.523529 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-85ecad8a-bb62-484c-b7a2-0e1188e94594 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:36.524217 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-85ecad8a-bb62-484c-b7a2-0e1188e94594 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:36.524664 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-85ecad8a-bb62-484c-b7a2-0e1188e94594 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:36.525088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-85ecad8a-bb62-484c-b7a2-0e1188e94594 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:36.733115 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-85ecad8a-bb62-484c-b7a2-0e1188e94594 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:36.742110 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-85ecad8a-bb62-484c-b7a2-0e1188e94594 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.230394 Sep 16 08:06:36.743152 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 80/178] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:36 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:36.845726 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-79f72b12-829c-47c4-bd58-0ab2a01980b1 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:36.846323 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-79f72b12-829c-47c4-bd58-0ab2a01980b1 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:36.852917 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-79f72b12-829c-47c4-bd58-0ab2a01980b1 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:36.853400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-79f72b12-829c-47c4-bd58-0ab2a01980b1 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:36.853915 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-79f72b12-829c-47c4-bd58-0ab2a01980b1 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:36.854625 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-79f72b12-829c-47c4-bd58-0ab2a01980b1 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:36.855231 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-79f72b12-829c-47c4-bd58-0ab2a01980b1 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:36.855665 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-79f72b12-829c-47c4-bd58-0ab2a01980b1 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:36.990419 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-79f72b12-829c-47c4-bd58-0ab2a01980b1 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:36.999906 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-79f72b12-829c-47c4-bd58-0ab2a01980b1 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1555 microversion: 2.1 time: 0.158172 Sep 16 08:06:37.000928 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 99/179] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:36 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1555 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:37.049606 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-a1451ef0-5cb6-453c-9e5b-eb920ce76d0c req-f6c3c990-eab0-46d5-8eb3-f5098c0f2ea6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "1ddef20f-e546-46b6-9282-f4fb7fc9cb86", "name": "network-vif-deleted", "tag": "7ba33ab1-123d-4e11-ba3e-f820f20c39b8"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:06:37.059291 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-a1451ef0-5cb6-453c-9e5b-eb920ce76d0c req-f6c3c990-eab0-46d5-8eb3-f5098c0f2ea6 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:37.059762 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-a1451ef0-5cb6-453c-9e5b-eb920ce76d0c req-f6c3c990-eab0-46d5-8eb3-f5098c0f2ea6 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:37.060421 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-a1451ef0-5cb6-453c-9e5b-eb920ce76d0c req-f6c3c990-eab0-46d5-8eb3-f5098c0f2ea6 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:37.081561 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-a1451ef0-5cb6-453c-9e5b-eb920ce76d0c req-f6c3c990-eab0-46d5-8eb3-f5098c0f2ea6 service nova] Creating event network-vif-deleted:7ba33ab1-123d-4e11-ba3e-f820f20c39b8 for instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 on hv-cinder-74014 Sep 16 08:06:37.087554 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-a1451ef0-5cb6-453c-9e5b-eb920ce76d0c req-f6c3c990-eab0-46d5-8eb3-f5098c0f2ea6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041941 Sep 16 08:06:37.088253 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 81/180] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:06:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:06:37.764825 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c3e8b739-836d-471b-b8bc-3ba80ae87d12 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:37.765430 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c3e8b739-836d-471b-b8bc-3ba80ae87d12 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:37.771650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c3e8b739-836d-471b-b8bc-3ba80ae87d12 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:37.772135 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c3e8b739-836d-471b-b8bc-3ba80ae87d12 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:37.772565 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c3e8b739-836d-471b-b8bc-3ba80ae87d12 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:37.773247 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c3e8b739-836d-471b-b8bc-3ba80ae87d12 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:37.773697 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c3e8b739-836d-471b-b8bc-3ba80ae87d12 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:37.774113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c3e8b739-836d-471b-b8bc-3ba80ae87d12 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:37.905739 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c3e8b739-836d-471b-b8bc-3ba80ae87d12 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:37.914719 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c3e8b739-836d-471b-b8bc-3ba80ae87d12 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.153449 Sep 16 08:06:37.915525 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 100/181] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:37 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:38.024686 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:38.025443 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:38.033555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:38.033555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:38.033731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:38.034710 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:38.035174 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:38.035605 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:38.068348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:38.069211 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:38.069662 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:38.070528 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lazy-loading 'fault' on Instance uuid 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:06:38.120727 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ae3824cef26941278065945a8ee37d32', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '48c466a9c78b46db90b2c979cf885f43', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:38.141068 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-51db5657-de56-468e-95c6-7d6e23833a24 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 200 len: 1351 microversion: 2.1 time: 0.119587 Sep 16 08:06:38.141686 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 82/182] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:38 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 1351 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:38.938253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f1bfbdf0-1585-4845-9e06-dc1b4667b885 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:38.939075 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f1bfbdf0-1585-4845-9e06-dc1b4667b885 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:38.945631 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f1bfbdf0-1585-4845-9e06-dc1b4667b885 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:38.946138 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f1bfbdf0-1585-4845-9e06-dc1b4667b885 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:38.946576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f1bfbdf0-1585-4845-9e06-dc1b4667b885 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:38.950781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f1bfbdf0-1585-4845-9e06-dc1b4667b885 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:38.950781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f1bfbdf0-1585-4845-9e06-dc1b4667b885 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:38.950781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f1bfbdf0-1585-4845-9e06-dc1b4667b885 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:39.128184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f1bfbdf0-1585-4845-9e06-dc1b4667b885 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:39.137584 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f1bfbdf0-1585-4845-9e06-dc1b4667b885 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.203228 Sep 16 08:06:39.138252 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 101/183] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:38 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:39.164350 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-eb5ca859-2744-4407-934d-74a2e765fddb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:39.164965 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-eb5ca859-2744-4407-934d-74a2e765fddb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:39.172295 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eb5ca859-2744-4407-934d-74a2e765fddb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:39.172785 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eb5ca859-2744-4407-934d-74a2e765fddb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:39.173280 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eb5ca859-2744-4407-934d-74a2e765fddb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:39.174067 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eb5ca859-2744-4407-934d-74a2e765fddb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:39.174432 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eb5ca859-2744-4407-934d-74a2e765fddb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:39.174892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eb5ca859-2744-4407-934d-74a2e765fddb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:39.189282 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-eb5ca859-2744-4407-934d-74a2e765fddb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] HTTP exception thrown: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-eb5ca859-2744-4407-934d-74a2e765fddb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Request method failure captured: Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 HTTP/1.1 Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5FtLjGwl4byQvt_bynF6y2GuRxaHzlXNWAzBldhIm9K4W2C5udfNaGYok4T78nqTCxgeqOJiDgBGCo6VIzP4ELhn1zcAhKYHLRGM2PqAGdqCJQ5N7K-3gfu1bo6zW_4qkaw2YFKWDTAmqlJ-NuxVGbm-w4V8kYCncgG0D7AMMSmYc Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 48c466a9c78b46db90b2c979cf885f43 Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-DeleteServersTestJSON-801011032 Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:06:39.194999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:06:39.196429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48c466a9c78b46db90b2c979cf885f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/48c466a9c78b46db90b2c979cf885f43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_48c466a9c78b46db90b2c979cf885f43", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48c466a9c78b46db90b2c979cf885f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:06:39.196429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-DeleteServersTestJSON-801011032 Sep 16 08:06:39.196429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 48c466a9c78b46db90b2c979cf885f43 Sep 16 08:06:39.196429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-DeleteServersTestJSON-801011032 Sep 16 08:06:39.196429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-DeleteServersTestJSON-801011032-project Sep 16 08:06:39.196429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:06:39.196429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:06:39.196429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: ae3824cef26941278065945a8ee37d32 Sep 16 08:06:39.196429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-DeleteServersTestJSON-801011032-project Sep 16 08:06:39.196429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:06:39.196429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:39.196429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '1ddef20f-e546-46b6-9282-f4fb7fc9cb86'} Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:06:39.197214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:39.198367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:06:39.199362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-eb5ca859-2744-4407-934d-74a2e765fddb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Returning 404 to user: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:06:39.199362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-eb5ca859-2744-4407-934d-74a2e765fddb tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 404 len: 111 microversion: 2.1 time: 0.036025 Sep 16 08:06:39.199362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 83/184] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:39 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 111 bytes in 37 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:06:39.314511 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ff9c3e0d-cbc9-4cc8-8ea2-3cbec1058174 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:39.316794 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ff9c3e0d-cbc9-4cc8-8ea2-3cbec1058174 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:39.323882 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff9c3e0d-cbc9-4cc8-8ea2-3cbec1058174 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:39.324423 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff9c3e0d-cbc9-4cc8-8ea2-3cbec1058174 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:39.324858 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff9c3e0d-cbc9-4cc8-8ea2-3cbec1058174 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:39.326152 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff9c3e0d-cbc9-4cc8-8ea2-3cbec1058174 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:39.326152 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff9c3e0d-cbc9-4cc8-8ea2-3cbec1058174 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:39.326620 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff9c3e0d-cbc9-4cc8-8ea2-3cbec1058174 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:39.330599 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-ff9c3e0d-cbc9-4cc8-8ea2-3cbec1058174 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] HTTP exception thrown: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ff9c3e0d-cbc9-4cc8-8ea2-3cbec1058174 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Request method failure captured: Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86/os-volume_attachments HTTP/1.1 Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5FtLjGwl4byQvt_bynF6y2GuRxaHzlXNWAzBldhIm9K4W2C5udfNaGYok4T78nqTCxgeqOJiDgBGCo6VIzP4ELhn1zcAhKYHLRGM2PqAGdqCJQ5N7K-3gfu1bo6zW_4qkaw2YFKWDTAmqlJ-NuxVGbm-w4V8kYCncgG0D7AMMSmYc Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 48c466a9c78b46db90b2c979cf885f43 Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-DeleteServersTestJSON-801011032 Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:06:39.347814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:06:39.349955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48c466a9c78b46db90b2c979cf885f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/48c466a9c78b46db90b2c979cf885f43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_48c466a9c78b46db90b2c979cf885f43", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48c466a9c78b46db90b2c979cf885f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:06:39.349955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-DeleteServersTestJSON-801011032 Sep 16 08:06:39.349955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 48c466a9c78b46db90b2c979cf885f43 Sep 16 08:06:39.349955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-DeleteServersTestJSON-801011032 Sep 16 08:06:39.349955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-DeleteServersTestJSON-801011032-project Sep 16 08:06:39.349955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:06:39.349955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:06:39.349955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: ae3824cef26941278065945a8ee37d32 Sep 16 08:06:39.349955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-DeleteServersTestJSON-801011032-project Sep 16 08:06:39.349955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:06:39.349955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:39.349955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'server_id': '1ddef20f-e546-46b6-9282-f4fb7fc9cb86'} Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:06:39.351688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 192, in wrapper Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 303, in index Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, server_id) Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:39.353211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:06:39.354785 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ff9c3e0d-cbc9-4cc8-8ea2-3cbec1058174 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Returning 404 to user: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:06:39.354785 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ff9c3e0d-cbc9-4cc8-8ea2-3cbec1058174 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86/os-volume_attachments" status: 404 len: 111 microversion: 2.1 time: 0.038633 Sep 16 08:06:39.354785 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 102/185] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:06:39 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86/os-volume_attachments => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:06:40.160154 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e16d76cf-138a-4114-919e-f3441d1ae274 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:40.160749 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e16d76cf-138a-4114-919e-f3441d1ae274 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:40.167570 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e16d76cf-138a-4114-919e-f3441d1ae274 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:40.168156 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e16d76cf-138a-4114-919e-f3441d1ae274 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:40.168475 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e16d76cf-138a-4114-919e-f3441d1ae274 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:40.169197 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e16d76cf-138a-4114-919e-f3441d1ae274 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:40.169651 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e16d76cf-138a-4114-919e-f3441d1ae274 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:40.170080 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e16d76cf-138a-4114-919e-f3441d1ae274 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:40.296682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e16d76cf-138a-4114-919e-f3441d1ae274 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:40.304426 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e16d76cf-138a-4114-919e-f3441d1ae274 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.148655 Sep 16 08:06:40.304993 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 84/186] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:40 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:40.800716 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-25c23900-a819-49dd-b4b6-8336c6384577 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:40.802548 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-25c23900-a819-49dd-b4b6-8336c6384577 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:40.808198 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=50 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:40.810399 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-25c23900-a819-49dd-b4b6-8336c6384577 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:40.810931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-25c23900-a819-49dd-b4b6-8336c6384577 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:40.811435 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-25c23900-a819-49dd-b4b6-8336c6384577 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:40.812059 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-25c23900-a819-49dd-b4b6-8336c6384577 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:40.812514 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-25c23900-a819-49dd-b4b6-8336c6384577 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:40.813095 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-25c23900-a819-49dd-b4b6-8336c6384577 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:40.845130 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-25c23900-a819-49dd-b4b6-8336c6384577 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] HTTP exception thrown: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-25c23900-a819-49dd-b4b6-8336c6384577 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Request method failure captured: Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: DELETE /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 HTTP/1.1 Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5FtLjGwl4byQvt_bynF6y2GuRxaHzlXNWAzBldhIm9K4W2C5udfNaGYok4T78nqTCxgeqOJiDgBGCo6VIzP4ELhn1zcAhKYHLRGM2PqAGdqCJQ5N7K-3gfu1bo6zW_4qkaw2YFKWDTAmqlJ-NuxVGbm-w4V8kYCncgG0D7AMMSmYc Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 48c466a9c78b46db90b2c979cf885f43 Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-DeleteServersTestJSON-801011032 Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:06:40.847452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:06:40.848834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48c466a9c78b46db90b2c979cf885f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/48c466a9c78b46db90b2c979cf885f43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_48c466a9c78b46db90b2c979cf885f43", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48c466a9c78b46db90b2c979cf885f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:06:40.848834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-DeleteServersTestJSON-801011032 Sep 16 08:06:40.848834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 48c466a9c78b46db90b2c979cf885f43 Sep 16 08:06:40.848834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-DeleteServersTestJSON-801011032 Sep 16 08:06:40.848834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-DeleteServersTestJSON-801011032-project Sep 16 08:06:40.848834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:06:40.848834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:06:40.848834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: ae3824cef26941278065945a8ee37d32 Sep 16 08:06:40.848834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-DeleteServersTestJSON-801011032-project Sep 16 08:06:40.848834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:06:40.848834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:40.848834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '1ddef20f-e546-46b6-9282-f4fb7fc9cb86'} Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:06:40.850096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:40.854318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:06:40.855823 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-25c23900-a819-49dd-b4b6-8336c6384577 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Returning 404 to user: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:06:40.855823 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-25c23900-a819-49dd-b4b6-8336c6384577 tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "DELETE /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 404 len: 111 microversion: 2.1 time: 0.056241 Sep 16 08:06:40.855823 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 103/187] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:06:40 2022] DELETE /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 111 bytes in 58 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:06:40.863204 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-42b5292b-99bd-4ada-abc2-26b4f6366b8b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:40.863833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-42b5292b-99bd-4ada-abc2-26b4f6366b8b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] [instance: 1ddef20f-e546-46b6-9282-f4fb7fc9cb86] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:40.877059 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-42b5292b-99bd-4ada-abc2-26b4f6366b8b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:40.877592 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-42b5292b-99bd-4ada-abc2-26b4f6366b8b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:40.878098 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-42b5292b-99bd-4ada-abc2-26b4f6366b8b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:40.878802 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-42b5292b-99bd-4ada-abc2-26b4f6366b8b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:40.879271 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-42b5292b-99bd-4ada-abc2-26b4f6366b8b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:40.879705 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-42b5292b-99bd-4ada-abc2-26b4f6366b8b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:40.903909 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-42b5292b-99bd-4ada-abc2-26b4f6366b8b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] HTTP exception thrown: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-42b5292b-99bd-4ada-abc2-26b4f6366b8b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Request method failure captured: Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 HTTP/1.1 Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5FtLjGwl4byQvt_bynF6y2GuRxaHzlXNWAzBldhIm9K4W2C5udfNaGYok4T78nqTCxgeqOJiDgBGCo6VIzP4ELhn1zcAhKYHLRGM2PqAGdqCJQ5N7K-3gfu1bo6zW_4qkaw2YFKWDTAmqlJ-NuxVGbm-w4V8kYCncgG0D7AMMSmYc Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 48c466a9c78b46db90b2c979cf885f43 Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-DeleteServersTestJSON-801011032 Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:06:40.906057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:06:40.907349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48c466a9c78b46db90b2c979cf885f43"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/48c466a9c78b46db90b2c979cf885f43"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_48c466a9c78b46db90b2c979cf885f43", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/48c466a9c78b46db90b2c979cf885f43"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:06:40.907349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-DeleteServersTestJSON-801011032 Sep 16 08:06:40.907349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 48c466a9c78b46db90b2c979cf885f43 Sep 16 08:06:40.907349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-DeleteServersTestJSON-801011032 Sep 16 08:06:40.907349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-DeleteServersTestJSON-801011032-project Sep 16 08:06:40.907349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:06:40.907349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:06:40.907349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: ae3824cef26941278065945a8ee37d32 Sep 16 08:06:40.907349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-DeleteServersTestJSON-801011032-project Sep 16 08:06:40.907349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:06:40.907349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:40.907349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '1ddef20f-e546-46b6-9282-f4fb7fc9cb86'} Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:06:40.908016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. Sep 16 08:06:40.909433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:06:40.911227 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-42b5292b-99bd-4ada-abc2-26b4f6366b8b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] Returning 404 to user: Instance 1ddef20f-e546-46b6-9282-f4fb7fc9cb86 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:06:40.912863 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-42b5292b-99bd-4ada-abc2-26b4f6366b8b tempest-DeleteServersTestJSON-801011032 tempest-DeleteServersTestJSON-801011032-project] 10.222.0.59 "GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86" status: 404 len: 111 microversion: 2.1 time: 0.055346 Sep 16 08:06:40.920295 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 85/188] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:40 2022] GET /compute/v2.1/servers/1ddef20f-e546-46b6-9282-f4fb7fc9cb86 => generated 111 bytes in 57 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:06:41.328471 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-592463a8-d608-42d9-a60c-679a1206daf1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:41.330657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-592463a8-d608-42d9-a60c-679a1206daf1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:41.338217 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-592463a8-d608-42d9-a60c-679a1206daf1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:41.339073 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-592463a8-d608-42d9-a60c-679a1206daf1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:41.339834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-592463a8-d608-42d9-a60c-679a1206daf1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:41.340549 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-592463a8-d608-42d9-a60c-679a1206daf1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:41.341182 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-592463a8-d608-42d9-a60c-679a1206daf1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:41.341769 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-592463a8-d608-42d9-a60c-679a1206daf1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:41.698568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-592463a8-d608-42d9-a60c-679a1206daf1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:41.707132 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-592463a8-d608-42d9-a60c-679a1206daf1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.382923 Sep 16 08:06:41.707713 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 104/189] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:41 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:42.759898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d8f9ee6d-c6a0-4ae1-a46c-fa3bab319af8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:42.759898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d8f9ee6d-c6a0-4ae1-a46c-fa3bab319af8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:42.759898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8f9ee6d-c6a0-4ae1-a46c-fa3bab319af8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:42.759898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8f9ee6d-c6a0-4ae1-a46c-fa3bab319af8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:42.761007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8f9ee6d-c6a0-4ae1-a46c-fa3bab319af8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:42.761007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8f9ee6d-c6a0-4ae1-a46c-fa3bab319af8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:42.761007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8f9ee6d-c6a0-4ae1-a46c-fa3bab319af8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:42.761007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d8f9ee6d-c6a0-4ae1-a46c-fa3bab319af8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:42.989533 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d8f9ee6d-c6a0-4ae1-a46c-fa3bab319af8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:43.030606 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d8f9ee6d-c6a0-4ae1-a46c-fa3bab319af8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.290072 Sep 16 08:06:43.033213 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 86/190] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:42 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 301 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:44.058198 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b5b480f0-dfa3-489c-a2c9-ce14cefeb003 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:44.058768 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b5b480f0-dfa3-489c-a2c9-ce14cefeb003 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:44.064862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b5b480f0-dfa3-489c-a2c9-ce14cefeb003 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:44.065543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b5b480f0-dfa3-489c-a2c9-ce14cefeb003 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:44.066053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b5b480f0-dfa3-489c-a2c9-ce14cefeb003 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:44.067008 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b5b480f0-dfa3-489c-a2c9-ce14cefeb003 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:44.067473 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b5b480f0-dfa3-489c-a2c9-ce14cefeb003 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:44.068031 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b5b480f0-dfa3-489c-a2c9-ce14cefeb003 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:44.406883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b5b480f0-dfa3-489c-a2c9-ce14cefeb003 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:44.417006 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b5b480f0-dfa3-489c-a2c9-ce14cefeb003 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.362792 Sep 16 08:06:44.419560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 105/191] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:44 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 364 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:45.441932 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2d7c88ef-1745-4169-8788-97a8e94a9d46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:45.443967 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2d7c88ef-1745-4169-8788-97a8e94a9d46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:45.455445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=49,nova_api:UPDATE=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:06:45.455445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2d7c88ef-1745-4169-8788-97a8e94a9d46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:45.455445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2d7c88ef-1745-4169-8788-97a8e94a9d46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:45.455445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2d7c88ef-1745-4169-8788-97a8e94a9d46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:45.456116 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2d7c88ef-1745-4169-8788-97a8e94a9d46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:45.456743 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2d7c88ef-1745-4169-8788-97a8e94a9d46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:45.457335 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2d7c88ef-1745-4169-8788-97a8e94a9d46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:45.652428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2d7c88ef-1745-4169-8788-97a8e94a9d46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:45.661051 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2d7c88ef-1745-4169-8788-97a8e94a9d46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.224340 Sep 16 08:06:45.662797 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 87/192] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:45 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:46.684919 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-80fe8f8d-88a2-49cf-9c27-5758dab21777 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:46.685652 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-80fe8f8d-88a2-49cf-9c27-5758dab21777 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:46.692476 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-80fe8f8d-88a2-49cf-9c27-5758dab21777 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:46.693685 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-80fe8f8d-88a2-49cf-9c27-5758dab21777 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:46.696895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-80fe8f8d-88a2-49cf-9c27-5758dab21777 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:46.696895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-80fe8f8d-88a2-49cf-9c27-5758dab21777 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:46.696895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-80fe8f8d-88a2-49cf-9c27-5758dab21777 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:46.696895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-80fe8f8d-88a2-49cf-9c27-5758dab21777 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:46.885314 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-80fe8f8d-88a2-49cf-9c27-5758dab21777 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:46.893881 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-80fe8f8d-88a2-49cf-9c27-5758dab21777 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.212777 Sep 16 08:06:46.894459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 106/193] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:46 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:47.918125 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-120124c6-d257-4a5c-be93-6e2bae063892 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:47.919133 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-120124c6-d257-4a5c-be93-6e2bae063892 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:47.929270 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-120124c6-d257-4a5c-be93-6e2bae063892 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:47.929827 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-120124c6-d257-4a5c-be93-6e2bae063892 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:47.933546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-120124c6-d257-4a5c-be93-6e2bae063892 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:47.933546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-120124c6-d257-4a5c-be93-6e2bae063892 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:47.933546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-120124c6-d257-4a5c-be93-6e2bae063892 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:47.933546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-120124c6-d257-4a5c-be93-6e2bae063892 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:48.233319 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-120124c6-d257-4a5c-be93-6e2bae063892 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:48.243700 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-120124c6-d257-4a5c-be93-6e2bae063892 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.329875 Sep 16 08:06:48.245341 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 88/194] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:47 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:49.272021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-91589720-3f8a-4cd4-b382-44327bd776b4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:49.272642 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-91589720-3f8a-4cd4-b382-44327bd776b4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:49.280809 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91589720-3f8a-4cd4-b382-44327bd776b4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:49.281307 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91589720-3f8a-4cd4-b382-44327bd776b4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:49.281755 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91589720-3f8a-4cd4-b382-44327bd776b4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:49.282451 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91589720-3f8a-4cd4-b382-44327bd776b4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:49.291359 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91589720-3f8a-4cd4-b382-44327bd776b4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:49.297793 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91589720-3f8a-4cd4-b382-44327bd776b4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:49.633348 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-91589720-3f8a-4cd4-b382-44327bd776b4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:49.639317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-91589720-3f8a-4cd4-b382-44327bd776b4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.374353 Sep 16 08:06:49.639986 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 107/195] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:49 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:50.665137 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4b388e75-4d8b-4fe1-b0b0-4b77d5a67ab4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:50.666643 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4b388e75-4d8b-4fe1-b0b0-4b77d5a67ab4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:50.677382 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4b388e75-4d8b-4fe1-b0b0-4b77d5a67ab4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:50.679070 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4b388e75-4d8b-4fe1-b0b0-4b77d5a67ab4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:50.683626 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4b388e75-4d8b-4fe1-b0b0-4b77d5a67ab4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:50.683626 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4b388e75-4d8b-4fe1-b0b0-4b77d5a67ab4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:50.683626 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4b388e75-4d8b-4fe1-b0b0-4b77d5a67ab4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:50.683626 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4b388e75-4d8b-4fe1-b0b0-4b77d5a67ab4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:50.959592 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-4b388e75-4d8b-4fe1-b0b0-4b77d5a67ab4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:50.984324 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4b388e75-4d8b-4fe1-b0b0-4b77d5a67ab4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.323626 Sep 16 08:06:50.985901 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 89/196] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:50 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 326 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:52.016503 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-12265b60-853f-48ef-87bc-0071e3249237 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:52.017125 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-12265b60-853f-48ef-87bc-0071e3249237 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:52.028345 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-12265b60-853f-48ef-87bc-0071e3249237 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:52.028839 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-12265b60-853f-48ef-87bc-0071e3249237 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:52.029708 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-12265b60-853f-48ef-87bc-0071e3249237 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:52.032390 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-12265b60-853f-48ef-87bc-0071e3249237 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:52.034713 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-12265b60-853f-48ef-87bc-0071e3249237 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:52.035559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-12265b60-853f-48ef-87bc-0071e3249237 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:52.367693 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-12265b60-853f-48ef-87bc-0071e3249237 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:52.378047 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-12265b60-853f-48ef-87bc-0071e3249237 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.368154 Sep 16 08:06:52.382815 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 108/197] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:52 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:53.404761 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-186e5b26-fff6-48e7-8bb6-7e1e7d492392 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:53.407901 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-186e5b26-fff6-48e7-8bb6-7e1e7d492392 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:53.424002 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-186e5b26-fff6-48e7-8bb6-7e1e7d492392 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:53.424788 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-186e5b26-fff6-48e7-8bb6-7e1e7d492392 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:53.425246 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-186e5b26-fff6-48e7-8bb6-7e1e7d492392 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:53.428885 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-186e5b26-fff6-48e7-8bb6-7e1e7d492392 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:53.431721 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-186e5b26-fff6-48e7-8bb6-7e1e7d492392 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:53.432186 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-186e5b26-fff6-48e7-8bb6-7e1e7d492392 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:53.718996 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-186e5b26-fff6-48e7-8bb6-7e1e7d492392 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:53.731495 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-186e5b26-fff6-48e7-8bb6-7e1e7d492392 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.331054 Sep 16 08:06:53.733164 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 90/198] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:53 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 333 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:54.760717 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-aaf76131-3b7e-4f28-9e47-c97a39a62178 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:54.761987 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-aaf76131-3b7e-4f28-9e47-c97a39a62178 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:54.776329 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-aaf76131-3b7e-4f28-9e47-c97a39a62178 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:54.785676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-aaf76131-3b7e-4f28-9e47-c97a39a62178 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:54.785676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-aaf76131-3b7e-4f28-9e47-c97a39a62178 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:54.785676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-aaf76131-3b7e-4f28-9e47-c97a39a62178 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:54.785676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-aaf76131-3b7e-4f28-9e47-c97a39a62178 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:54.786671 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-aaf76131-3b7e-4f28-9e47-c97a39a62178 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:55.122670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-aaf76131-3b7e-4f28-9e47-c97a39a62178 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:55.133960 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-aaf76131-3b7e-4f28-9e47-c97a39a62178 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.376996 Sep 16 08:06:55.134554 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 109/199] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:54 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 378 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:56.156587 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f333797a-f490-4864-b9a6-0045ad3066aa tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:56.157377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f333797a-f490-4864-b9a6-0045ad3066aa tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:56.166593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f333797a-f490-4864-b9a6-0045ad3066aa tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:56.171050 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f333797a-f490-4864-b9a6-0045ad3066aa tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:56.171848 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f333797a-f490-4864-b9a6-0045ad3066aa tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:56.172788 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f333797a-f490-4864-b9a6-0045ad3066aa tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:56.173414 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f333797a-f490-4864-b9a6-0045ad3066aa tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:56.174003 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f333797a-f490-4864-b9a6-0045ad3066aa tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:56.515113 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f333797a-f490-4864-b9a6-0045ad3066aa tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:56.527398 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f333797a-f490-4864-b9a6-0045ad3066aa tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1521 microversion: 2.1 time: 0.373731 Sep 16 08:06:56.529427 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 91/200] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:56 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1521 bytes in 377 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:57.553407 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f029d7bc-41e1-4896-8c22-3b148e8b2ba4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:57.554035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f029d7bc-41e1-4896-8c22-3b148e8b2ba4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:57.569354 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f029d7bc-41e1-4896-8c22-3b148e8b2ba4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:57.569935 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f029d7bc-41e1-4896-8c22-3b148e8b2ba4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:57.570588 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f029d7bc-41e1-4896-8c22-3b148e8b2ba4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:57.571946 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f029d7bc-41e1-4896-8c22-3b148e8b2ba4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:57.572527 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f029d7bc-41e1-4896-8c22-3b148e8b2ba4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:57.572827 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f029d7bc-41e1-4896-8c22-3b148e8b2ba4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:57.867504 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f029d7bc-41e1-4896-8c22-3b148e8b2ba4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:57.880061 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f029d7bc-41e1-4896-8c22-3b148e8b2ba4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1501 microversion: 2.1 time: 0.324686 Sep 16 08:06:57.882526 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 110/201] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:57 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1501 bytes in 336 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:57.922642 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c8fb7c2c-16dd-4ab7-8b6f-c4fb128716e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:06:57.924364 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c8fb7c2c-16dd-4ab7-8b6f-c4fb128716e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:06:57.934104 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c8fb7c2c-16dd-4ab7-8b6f-c4fb128716e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:57.934877 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c8fb7c2c-16dd-4ab7-8b6f-c4fb128716e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:57.935524 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c8fb7c2c-16dd-4ab7-8b6f-c4fb128716e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:57.936382 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c8fb7c2c-16dd-4ab7-8b6f-c4fb128716e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:06:57.937897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c8fb7c2c-16dd-4ab7-8b6f-c4fb128716e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:06:57.938664 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c8fb7c2c-16dd-4ab7-8b6f-c4fb128716e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:06:58.416563 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c8fb7c2c-16dd-4ab7-8b6f-c4fb128716e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:06:58.427938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c8fb7c2c-16dd-4ab7-8b6f-c4fb128716e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1515 microversion: 2.1 time: 0.522952 Sep 16 08:06:58.428891 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 92/202] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:06:57 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1515 bytes in 526 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:06:59.109055 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-00d88edd-e3d7-47ef-bdd0-72241eec9664 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Action: 'create', calling method: .version_select at 0x7f9d06bfe4c0>, body: {"keypair": {"name": "tempest-keypair-1595443651", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBBUgI/FoIPxbBwDpYEnvcElOqvFbZk4jc9TjlQZdujde/j1xzYWT/tZD/l7hfkOyjoYVuwNX6bUlQ7GXiZ+6pbL5xVIL35lZ9yW+LqETU8r4pacaOl2Lyt+p3I3t0CjfVg=="}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:06:59.145720 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-00d88edd-e3d7-47ef-bdd0-72241eec9664 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Getting quotas for project 8191457181714862bbeb70259fa86971. Resources: {'key_pairs'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:06:59.152826 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-00d88edd-e3d7-47ef-bdd0-72241eec9664 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Getting quotas for user 81e89f8fb70d49d18cd0c81c98dd4add and project 8191457181714862bbeb70259fa86971. Resources: {'key_pairs'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:06:59.295838 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-00d88edd-e3d7-47ef-bdd0-72241eec9664 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.352808 Sep 16 08:06:59.297068 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 111/203] 10.222.0.59 () {62 vars in 1200 bytes} [Fri Sep 16 08:06:58 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 355 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 08:07:02.591067 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1589248024", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98ee904d-e719-4f43-92f8-977801b2d6d2"}], "security_groups": [{"name": "tempest-securitygroup--1666831299"}], "key_name": "tempest-keypair-1595443651", "user_data": "}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:02.783161 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.network.neutron [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] validate_networks() for [('98ee904d-e719-4f43-92f8-977801b2d6d2', None, None, None, None, None)] {{(pid=121047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:07:02.878064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-bcc87c96-0b9c-4fdd-8423-a1c599d7b94b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:02.880452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-bcc87c96-0b9c-4fdd-8423-a1c599d7b94b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:02.950972 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bcc87c96-0b9c-4fdd-8423-a1c599d7b94b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:02.952340 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bcc87c96-0b9c-4fdd-8423-a1c599d7b94b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:02.955141 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bcc87c96-0b9c-4fdd-8423-a1c599d7b94b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:02.956329 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bcc87c96-0b9c-4fdd-8423-a1c599d7b94b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:02.956498 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bcc87c96-0b9c-4fdd-8423-a1c599d7b94b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:02.956930 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bcc87c96-0b9c-4fdd-8423-a1c599d7b94b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:03.009986 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-bcc87c96-0b9c-4fdd-8423-a1c599d7b94b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lazy-loading 'flavor' on Instance uuid c6e123e7-4239-4c3a-8e4b-363f1a2bc058 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:07:03.390004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-bcc87c96-0b9c-4fdd-8423-a1c599d7b94b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "POST /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058/action" status: 200 len: 32 microversion: 2.1 time: 0.528324 Sep 16 08:07:03.397837 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 112/204] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:07:02 2022] POST /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058/action => generated 32 bytes in 537 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 08:07:03.413736 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-53015652-0fc0-4739-a812-948bf937faeb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:03.420336 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-53015652-0fc0-4739-a812-948bf937faeb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:03.440622 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-53015652-0fc0-4739-a812-948bf937faeb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:03.443867 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-53015652-0fc0-4739-a812-948bf937faeb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:03.446315 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-53015652-0fc0-4739-a812-948bf937faeb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:03.453473 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-53015652-0fc0-4739-a812-948bf937faeb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:03.454707 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-53015652-0fc0-4739-a812-948bf937faeb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:03.455171 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-53015652-0fc0-4739-a812-948bf937faeb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:03.529169 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Flavor limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:07:03.529596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Image limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:07:03.530082 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Flavor pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:07:03.530492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Image pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:07:03.534616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:07:03.561940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:03.563266 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:03.565122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:03.569350 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:03.572364 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:03.573049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:03.600879 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Getting quotas for project 8191457181714862bbeb70259fa86971. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:07:03.605321 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Getting quotas for user 81e89f8fb70d49d18cd0c81c98dd4add and project 8191457181714862bbeb70259fa86971. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:07:03.620342 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Going to run 1 instances... {{(pid=121047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:07:03.622949 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:07:03.793970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-188cc9a5-2945-484e-ba9e-1f784e6c6099 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.20 time: 1.211094 Sep 16 08:07:03.795394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 93/205] 10.222.0.59 () {62 vars in 1188 bytes} [Fri Sep 16 08:07:02 2022] POST /compute/v2.1/servers => generated 402 bytes in 1214 msecs (HTTP/1.1 202) 10 headers in 453 bytes (2 switches on core 0) Sep 16 08:07:03.803170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-53015652-0fc0-4739-a812-948bf937faeb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:03.824581 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-53015652-0fc0-4739-a812-948bf937faeb tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.425362 Sep 16 08:07:03.825754 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 113/206] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:03 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 427 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:03.830898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6f2c3404-d802-4991-a7ee-3e3b66a30305 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:03.832549 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6f2c3404-d802-4991-a7ee-3e3b66a30305 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:03.995975 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6f2c3404-d802-4991-a7ee-3e3b66a30305 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:04.006082 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6f2c3404-d802-4991-a7ee-3e3b66a30305 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:04.008069 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6f2c3404-d802-4991-a7ee-3e3b66a30305 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:04.010258 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6f2c3404-d802-4991-a7ee-3e3b66a30305 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1282 microversion: 2.20 time: 0.205082 Sep 16 08:07:04.025327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 94/207] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:03 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1282 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:04.260817 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ddfbb1a4-93b6-46a9-83ce-1916c5812335 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:04.261271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ddfbb1a4-93b6-46a9-83ce-1916c5812335 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:04.296619 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ddfbb1a4-93b6-46a9-83ce-1916c5812335 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:04.296619 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ddfbb1a4-93b6-46a9-83ce-1916c5812335 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:04.296619 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ddfbb1a4-93b6-46a9-83ce-1916c5812335 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:04.296619 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ddfbb1a4-93b6-46a9-83ce-1916c5812335 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:04.296959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ddfbb1a4-93b6-46a9-83ce-1916c5812335 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:04.297352 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ddfbb1a4-93b6-46a9-83ce-1916c5812335 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:04.338029 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ddfbb1a4-93b6-46a9-83ce-1916c5812335 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/ips" status: 200 len: 145 microversion: 2.1 time: 0.083524 Sep 16 08:07:04.338620 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 114/208] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Sep 16 08:07:04 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/ips => generated 145 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:07:04.853713 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-24b1fd70-e600-4848-a0d0-84dec4242967 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:04.855009 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-24b1fd70-e600-4848-a0d0-84dec4242967 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:04.866758 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24b1fd70-e600-4848-a0d0-84dec4242967 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:04.867498 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24b1fd70-e600-4848-a0d0-84dec4242967 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:04.867948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24b1fd70-e600-4848-a0d0-84dec4242967 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:04.869203 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24b1fd70-e600-4848-a0d0-84dec4242967 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:04.870037 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24b1fd70-e600-4848-a0d0-84dec4242967 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:04.870457 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24b1fd70-e600-4848-a0d0-84dec4242967 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:05.039703 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d7fecf4a-ebc4-4969-bc26-c8fd501aa848 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:05.040790 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d7fecf4a-ebc4-4969-bc26-c8fd501aa848 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:05.096658 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-24b1fd70-e600-4848-a0d0-84dec4242967 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:05.111349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-24b1fd70-e600-4848-a0d0-84dec4242967 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.256731 Sep 16 08:07:05.112219 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 95/209] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:04 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:05.276146 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d7fecf4a-ebc4-4969-bc26-c8fd501aa848 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:05.276146 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d7fecf4a-ebc4-4969-bc26-c8fd501aa848 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:05.279768 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d7fecf4a-ebc4-4969-bc26-c8fd501aa848 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:05.279768 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d7fecf4a-ebc4-4969-bc26-c8fd501aa848 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1282 microversion: 2.20 time: 0.128197 Sep 16 08:07:05.279768 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 115/210] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:05 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1282 bytes in 132 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:05.548088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c81e44cc-5bdc-4475-b6a0-47fa5d75fef0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:05.548828 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c81e44cc-5bdc-4475-b6a0-47fa5d75fef0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:05.556475 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c81e44cc-5bdc-4475-b6a0-47fa5d75fef0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:05.557214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c81e44cc-5bdc-4475-b6a0-47fa5d75fef0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:05.557814 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c81e44cc-5bdc-4475-b6a0-47fa5d75fef0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:05.558904 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c81e44cc-5bdc-4475-b6a0-47fa5d75fef0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:05.559539 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c81e44cc-5bdc-4475-b6a0-47fa5d75fef0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:05.560127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c81e44cc-5bdc-4475-b6a0-47fa5d75fef0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:05.563259 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=81 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:05.600091 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c81e44cc-5bdc-4475-b6a0-47fa5d75fef0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/ips" status: 200 len: 148 microversion: 2.1 time: 0.058795 Sep 16 08:07:05.600867 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 96/211] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Sep 16 08:07:05 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/ips => generated 148 bytes in 61 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:07:06.143089 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2d3b5289-6cf7-472f-9694-0617a3f9f3bd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:06.143771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2d3b5289-6cf7-472f-9694-0617a3f9f3bd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:06.156298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2d3b5289-6cf7-472f-9694-0617a3f9f3bd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:06.157968 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2d3b5289-6cf7-472f-9694-0617a3f9f3bd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:06.160046 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2d3b5289-6cf7-472f-9694-0617a3f9f3bd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:06.161049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2d3b5289-6cf7-472f-9694-0617a3f9f3bd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:06.162576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2d3b5289-6cf7-472f-9694-0617a3f9f3bd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:06.163118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2d3b5289-6cf7-472f-9694-0617a3f9f3bd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:06.307023 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-eeeca96a-7fd0-41a6-8f8b-14a8ca261c81 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:06.308347 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-eeeca96a-7fd0-41a6-8f8b-14a8ca261c81 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:06.319104 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eeeca96a-7fd0-41a6-8f8b-14a8ca261c81 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:06.319993 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eeeca96a-7fd0-41a6-8f8b-14a8ca261c81 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:06.320952 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eeeca96a-7fd0-41a6-8f8b-14a8ca261c81 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:06.321977 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eeeca96a-7fd0-41a6-8f8b-14a8ca261c81 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:06.322891 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eeeca96a-7fd0-41a6-8f8b-14a8ca261c81 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:06.323825 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eeeca96a-7fd0-41a6-8f8b-14a8ca261c81 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:06.406642 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2d3b5289-6cf7-472f-9694-0617a3f9f3bd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:06.417480 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2d3b5289-6cf7-472f-9694-0617a3f9f3bd tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.281639 Sep 16 08:07:06.418404 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 116/212] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:06 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:06.467765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-eeeca96a-7fd0-41a6-8f8b-14a8ca261c81 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:06.479732 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-eeeca96a-7fd0-41a6-8f8b-14a8ca261c81 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:06.481209 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-eeeca96a-7fd0-41a6-8f8b-14a8ca261c81 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:06.482338 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-eeeca96a-7fd0-41a6-8f8b-14a8ca261c81 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1286 microversion: 2.20 time: 0.185159 Sep 16 08:07:06.499874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 97/213] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:06 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1286 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:07:07.442387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-14fe5c88-2b4b-4a2b-81dd-f2c2a4f57f35 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:07.443017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-14fe5c88-2b4b-4a2b-81dd-f2c2a4f57f35 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:07.455523 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-14fe5c88-2b4b-4a2b-81dd-f2c2a4f57f35 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:07.456269 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-14fe5c88-2b4b-4a2b-81dd-f2c2a4f57f35 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:07.457922 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-14fe5c88-2b4b-4a2b-81dd-f2c2a4f57f35 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:07.460260 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-14fe5c88-2b4b-4a2b-81dd-f2c2a4f57f35 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:07.460743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-14fe5c88-2b4b-4a2b-81dd-f2c2a4f57f35 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:07.465393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-14fe5c88-2b4b-4a2b-81dd-f2c2a4f57f35 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:07.518132 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-329b6f19-3a53-4296-b68d-d5eaeab6b1eb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:07.518132 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-329b6f19-3a53-4296-b68d-d5eaeab6b1eb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:07.530478 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-329b6f19-3a53-4296-b68d-d5eaeab6b1eb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:07.531064 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-329b6f19-3a53-4296-b68d-d5eaeab6b1eb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:07.531510 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-329b6f19-3a53-4296-b68d-d5eaeab6b1eb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:07.534111 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-329b6f19-3a53-4296-b68d-d5eaeab6b1eb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:07.534595 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-329b6f19-3a53-4296-b68d-d5eaeab6b1eb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:07.535064 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-329b6f19-3a53-4296-b68d-d5eaeab6b1eb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:07.638650 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-329b6f19-3a53-4296-b68d-d5eaeab6b1eb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:07.651432 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-329b6f19-3a53-4296-b68d-d5eaeab6b1eb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:07.654004 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-329b6f19-3a53-4296-b68d-d5eaeab6b1eb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:07.655506 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-329b6f19-3a53-4296-b68d-d5eaeab6b1eb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1286 microversion: 2.20 time: 0.149443 Sep 16 08:07:07.670506 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 98/214] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:07 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1286 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:07:07.870873 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-14fe5c88-2b4b-4a2b-81dd-f2c2a4f57f35 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:07.881571 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-14fe5c88-2b4b-4a2b-81dd-f2c2a4f57f35 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.443028 Sep 16 08:07:07.882635 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 117/215] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:07 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 446 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:08.684361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-24395830-74d2-4d2c-b449-6914fc758985 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:08.685096 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-24395830-74d2-4d2c-b449-6914fc758985 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:08.696319 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24395830-74d2-4d2c-b449-6914fc758985 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:08.696820 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24395830-74d2-4d2c-b449-6914fc758985 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:08.697264 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24395830-74d2-4d2c-b449-6914fc758985 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:08.697999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24395830-74d2-4d2c-b449-6914fc758985 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:08.698547 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24395830-74d2-4d2c-b449-6914fc758985 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:08.701646 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-24395830-74d2-4d2c-b449-6914fc758985 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:08.816022 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-24395830-74d2-4d2c-b449-6914fc758985 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:08.830186 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-24395830-74d2-4d2c-b449-6914fc758985 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:08.834200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-24395830-74d2-4d2c-b449-6914fc758985 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:08.834200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-24395830-74d2-4d2c-b449-6914fc758985 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1334 microversion: 2.20 time: 0.153772 Sep 16 08:07:08.835492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 99/216] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:08 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1334 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:08.843474 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ae277808-62ad-4929-b102-c529fb68dc41 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17d53de9-2afe-4288-ad69-afce393e4fcd"}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:08.849662 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ae277808-62ad-4929-b102-c529fb68dc41 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:08.878017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ae277808-62ad-4929-b102-c529fb68dc41 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:08.882132 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ae277808-62ad-4929-b102-c529fb68dc41 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:08.883377 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ae277808-62ad-4929-b102-c529fb68dc41 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:08.885525 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ae277808-62ad-4929-b102-c529fb68dc41 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:08.887208 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ae277808-62ad-4929-b102-c529fb68dc41 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:08.889050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ae277808-62ad-4929-b102-c529fb68dc41 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:08.905357 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a87c0689-8f1b-4397-bd57-488d5107a040 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:08.906272 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a87c0689-8f1b-4397-bd57-488d5107a040 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:08.919610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a87c0689-8f1b-4397-bd57-488d5107a040 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:08.920114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a87c0689-8f1b-4397-bd57-488d5107a040 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:08.920565 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a87c0689-8f1b-4397-bd57-488d5107a040 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:08.921284 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a87c0689-8f1b-4397-bd57-488d5107a040 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:08.921744 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a87c0689-8f1b-4397-bd57-488d5107a040 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:08.922173 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a87c0689-8f1b-4397-bd57-488d5107a040 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:09.100567 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a87c0689-8f1b-4397-bd57-488d5107a040 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:09.118875 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a87c0689-8f1b-4397-bd57-488d5107a040 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.209061 Sep 16 08:07:09.119963 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 100/217] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:08 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:09.865667 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e8b5bba7-e149-4e53-8495-937914cd9e48 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:09.867200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e8b5bba7-e149-4e53-8495-937914cd9e48 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:09.874315 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e8b5bba7-e149-4e53-8495-937914cd9e48 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:09.875114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e8b5bba7-e149-4e53-8495-937914cd9e48 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:09.875798 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e8b5bba7-e149-4e53-8495-937914cd9e48 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:09.876698 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e8b5bba7-e149-4e53-8495-937914cd9e48 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:09.877619 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e8b5bba7-e149-4e53-8495-937914cd9e48 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:09.878242 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e8b5bba7-e149-4e53-8495-937914cd9e48 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:09.958395 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e8b5bba7-e149-4e53-8495-937914cd9e48 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:09.970031 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e8b5bba7-e149-4e53-8495-937914cd9e48 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:09.971995 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e8b5bba7-e149-4e53-8495-937914cd9e48 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:09.973576 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e8b5bba7-e149-4e53-8495-937914cd9e48 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1342 microversion: 2.20 time: 0.112221 Sep 16 08:07:09.979055 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 101/218] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:09 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1342 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:10.144119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2dcf92b0-0e53-4990-911d-45754d148738 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:10.149305 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2dcf92b0-0e53-4990-911d-45754d148738 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:10.160964 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2dcf92b0-0e53-4990-911d-45754d148738 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:10.161571 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2dcf92b0-0e53-4990-911d-45754d148738 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:10.162046 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2dcf92b0-0e53-4990-911d-45754d148738 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:10.166602 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2dcf92b0-0e53-4990-911d-45754d148738 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:10.170546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2dcf92b0-0e53-4990-911d-45754d148738 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:10.171223 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2dcf92b0-0e53-4990-911d-45754d148738 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:10.400169 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2dcf92b0-0e53-4990-911d-45754d148738 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:10.409167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2dcf92b0-0e53-4990-911d-45754d148738 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.269197 Sep 16 08:07:10.419937 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 102/219] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:10 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:10.432783 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ae277808-62ad-4929-b102-c529fb68dc41 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.602544 Sep 16 08:07:10.434150 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 118/220] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:07:08 2022] POST /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/os-volume_attachments => generated 194 bytes in 1605 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:07:10.745198 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4c6e3efe-e2a2-4727-b4df-78214661c49b tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "05470364-d81a-4cf6-a06b-0bcb78a5fa95"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:10.749241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4c6e3efe-e2a2-4727-b4df-78214661c49b tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:10.765005 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4c6e3efe-e2a2-4727-b4df-78214661c49b tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:10.769004 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4c6e3efe-e2a2-4727-b4df-78214661c49b tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:10.769004 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4c6e3efe-e2a2-4727-b4df-78214661c49b tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:10.769004 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4c6e3efe-e2a2-4727-b4df-78214661c49b tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:10.769004 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4c6e3efe-e2a2-4727-b4df-78214661c49b tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:10.769506 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4c6e3efe-e2a2-4727-b4df-78214661c49b tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:11.003978 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0b31cd94-edd3-4c5f-b9a2-2fdabf3eaf9d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:11.005502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0b31cd94-edd3-4c5f-b9a2-2fdabf3eaf9d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:11.015976 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0b31cd94-edd3-4c5f-b9a2-2fdabf3eaf9d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:11.015976 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0b31cd94-edd3-4c5f-b9a2-2fdabf3eaf9d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:11.015976 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0b31cd94-edd3-4c5f-b9a2-2fdabf3eaf9d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:11.015976 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0b31cd94-edd3-4c5f-b9a2-2fdabf3eaf9d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:11.016400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0b31cd94-edd3-4c5f-b9a2-2fdabf3eaf9d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:11.016400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0b31cd94-edd3-4c5f-b9a2-2fdabf3eaf9d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:11.045889 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=93,nova_cell1:UPDATE=4,nova_cell1:INSERT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:11.247520 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0b31cd94-edd3-4c5f-b9a2-2fdabf3eaf9d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:11.259345 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0b31cd94-edd3-4c5f-b9a2-2fdabf3eaf9d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:11.261362 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0b31cd94-edd3-4c5f-b9a2-2fdabf3eaf9d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:11.262973 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0b31cd94-edd3-4c5f-b9a2-2fdabf3eaf9d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.264062 Sep 16 08:07:11.264130 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 119/221] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:10 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:07:11.444193 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3e68a9a3-2585-4d94-9f58-60d5c4970e83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:11.446192 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3e68a9a3-2585-4d94-9f58-60d5c4970e83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:11.450254 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=45,nova_api:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:11.454624 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e68a9a3-2585-4d94-9f58-60d5c4970e83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:11.456093 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e68a9a3-2585-4d94-9f58-60d5c4970e83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:11.483780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e68a9a3-2585-4d94-9f58-60d5c4970e83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.027s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:11.485141 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e68a9a3-2585-4d94-9f58-60d5c4970e83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:11.487012 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e68a9a3-2585-4d94-9f58-60d5c4970e83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:11.489486 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e68a9a3-2585-4d94-9f58-60d5c4970e83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:11.729110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3e68a9a3-2585-4d94-9f58-60d5c4970e83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:11.740005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3e68a9a3-2585-4d94-9f58-60d5c4970e83 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.307206 Sep 16 08:07:11.756363 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 120/222] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:11 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:12.300809 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-84101259-d012-41d1-8259-8cd0266dbabb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:12.301754 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-84101259-d012-41d1-8259-8cd0266dbabb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:12.321208 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-84101259-d012-41d1-8259-8cd0266dbabb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:12.330922 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-84101259-d012-41d1-8259-8cd0266dbabb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:12.330922 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-84101259-d012-41d1-8259-8cd0266dbabb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.009s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:12.330922 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-84101259-d012-41d1-8259-8cd0266dbabb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:12.330922 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-84101259-d012-41d1-8259-8cd0266dbabb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:12.340869 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-84101259-d012-41d1-8259-8cd0266dbabb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:12.508963 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-84101259-d012-41d1-8259-8cd0266dbabb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:12.523789 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-84101259-d012-41d1-8259-8cd0266dbabb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:12.527906 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-84101259-d012-41d1-8259-8cd0266dbabb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:12.529970 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-84101259-d012-41d1-8259-8cd0266dbabb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.233345 Sep 16 08:07:12.561238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 121/223] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:12 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:07:12.765305 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-fe17e420-0aea-487b-a7ed-000eca06244a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:12.765919 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-fe17e420-0aea-487b-a7ed-000eca06244a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:12.772053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fe17e420-0aea-487b-a7ed-000eca06244a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:12.772535 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fe17e420-0aea-487b-a7ed-000eca06244a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:12.772970 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fe17e420-0aea-487b-a7ed-000eca06244a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:12.773655 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fe17e420-0aea-487b-a7ed-000eca06244a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:12.774109 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fe17e420-0aea-487b-a7ed-000eca06244a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:12.774535 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fe17e420-0aea-487b-a7ed-000eca06244a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:12.924370 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-fe17e420-0aea-487b-a7ed-000eca06244a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:12.948621 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-fe17e420-0aea-487b-a7ed-000eca06244a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.187225 Sep 16 08:07:12.949216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 122/224] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:12 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:12.957518 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-837017da-b07f-4c3d-9429-3087ad4caf75 req-c6815e95-10e2-4a7a-8d28-cf6ca1fab3a2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c", "tag": "0104ad2b-b1c9-455f-a512-cdc1dd34408e"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:12.969650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-837017da-b07f-4c3d-9429-3087ad4caf75 req-c6815e95-10e2-4a7a-8d28-cf6ca1fab3a2 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:12.971297 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-837017da-b07f-4c3d-9429-3087ad4caf75 req-c6815e95-10e2-4a7a-8d28-cf6ca1fab3a2 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:12.971297 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-837017da-b07f-4c3d-9429-3087ad4caf75 req-c6815e95-10e2-4a7a-8d28-cf6ca1fab3a2 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:12.982618 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-837017da-b07f-4c3d-9429-3087ad4caf75 req-c6815e95-10e2-4a7a-8d28-cf6ca1fab3a2 service nova] Creating event network-changed:0104ad2b-b1c9-455f-a512-cdc1dd34408e for instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c on hv-cinder-74014 Sep 16 08:07:12.987705 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-837017da-b07f-4c3d-9429-3087ad4caf75 req-c6815e95-10e2-4a7a-8d28-cf6ca1fab3a2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033810 Sep 16 08:07:12.988885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 123/225] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:07:12 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:07:13.025783 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4c6e3efe-e2a2-4727-b4df-78214661c49b tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "POST /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 2.288947 Sep 16 08:07:13.028421 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 103/226] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:07:10 2022] POST /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/os-volume_attachments => generated 194 bytes in 2291 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:07:13.560107 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a473e6a7-bd5b-4fef-8f0d-d9cdf03caaab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:13.560832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a473e6a7-bd5b-4fef-8f0d-d9cdf03caaab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:13.568563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a473e6a7-bd5b-4fef-8f0d-d9cdf03caaab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:13.569149 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a473e6a7-bd5b-4fef-8f0d-d9cdf03caaab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:13.569586 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a473e6a7-bd5b-4fef-8f0d-d9cdf03caaab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:13.570281 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a473e6a7-bd5b-4fef-8f0d-d9cdf03caaab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:13.570765 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a473e6a7-bd5b-4fef-8f0d-d9cdf03caaab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:13.571200 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a473e6a7-bd5b-4fef-8f0d-d9cdf03caaab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:13.747148 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a473e6a7-bd5b-4fef-8f0d-d9cdf03caaab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:13.760483 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a473e6a7-bd5b-4fef-8f0d-d9cdf03caaab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:13.762066 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a473e6a7-bd5b-4fef-8f0d-d9cdf03caaab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:13.763300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a473e6a7-bd5b-4fef-8f0d-d9cdf03caaab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.208904 Sep 16 08:07:13.766912 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 124/227] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:13 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:13.971406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:13.975900 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7ef97a67-f0f3-4eea-b78a-7e6e3b499b46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:13.976833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7ef97a67-f0f3-4eea-b78a-7e6e3b499b46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:13.985483 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ef97a67-f0f3-4eea-b78a-7e6e3b499b46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:13.986277 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ef97a67-f0f3-4eea-b78a-7e6e3b499b46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:13.986936 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ef97a67-f0f3-4eea-b78a-7e6e3b499b46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:13.987819 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ef97a67-f0f3-4eea-b78a-7e6e3b499b46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:13.988300 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ef97a67-f0f3-4eea-b78a-7e6e3b499b46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:13.989018 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ef97a67-f0f3-4eea-b78a-7e6e3b499b46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:14.007885 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=8 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:14.148961 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7ef97a67-f0f3-4eea-b78a-7e6e3b499b46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:14.161713 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7ef97a67-f0f3-4eea-b78a-7e6e3b499b46 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.191905 Sep 16 08:07:14.174904 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 104/228] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:13 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:14.790253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c9a6c2ac-44d5-468f-8e98-c7e12d072e23 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:14.791014 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c9a6c2ac-44d5-468f-8e98-c7e12d072e23 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:14.798161 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c9a6c2ac-44d5-468f-8e98-c7e12d072e23 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:14.798870 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c9a6c2ac-44d5-468f-8e98-c7e12d072e23 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:14.799422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c9a6c2ac-44d5-468f-8e98-c7e12d072e23 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:14.800308 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c9a6c2ac-44d5-468f-8e98-c7e12d072e23 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:14.800905 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c9a6c2ac-44d5-468f-8e98-c7e12d072e23 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:14.801430 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c9a6c2ac-44d5-468f-8e98-c7e12d072e23 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:14.971319 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c9a6c2ac-44d5-468f-8e98-c7e12d072e23 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:15.015095 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c9a6c2ac-44d5-468f-8e98-c7e12d072e23 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:15.016658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c9a6c2ac-44d5-468f-8e98-c7e12d072e23 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:15.017804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c9a6c2ac-44d5-468f-8e98-c7e12d072e23 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.231882 Sep 16 08:07:15.028196 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 125/229] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:14 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:15.186461 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f67eb408-df3c-4e80-9f6c-f71ded481c84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:15.187203 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f67eb408-df3c-4e80-9f6c-f71ded481c84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:15.196739 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f67eb408-df3c-4e80-9f6c-f71ded481c84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:15.197439 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f67eb408-df3c-4e80-9f6c-f71ded481c84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:15.198113 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f67eb408-df3c-4e80-9f6c-f71ded481c84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:15.199284 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f67eb408-df3c-4e80-9f6c-f71ded481c84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:15.199996 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f67eb408-df3c-4e80-9f6c-f71ded481c84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:15.200640 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f67eb408-df3c-4e80-9f6c-f71ded481c84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:15.773720 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f67eb408-df3c-4e80-9f6c-f71ded481c84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:15.783302 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f67eb408-df3c-4e80-9f6c-f71ded481c84 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.601374 Sep 16 08:07:15.784183 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 105/230] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:15 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 603 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:16.044724 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b64880d1-3ee6-4754-99cd-e655f28eaadd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:16.045328 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b64880d1-3ee6-4754-99cd-e655f28eaadd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:16.047714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=6 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:16.054105 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b64880d1-3ee6-4754-99cd-e655f28eaadd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:16.054588 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b64880d1-3ee6-4754-99cd-e655f28eaadd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:16.055063 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b64880d1-3ee6-4754-99cd-e655f28eaadd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:16.055772 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b64880d1-3ee6-4754-99cd-e655f28eaadd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:16.056279 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b64880d1-3ee6-4754-99cd-e655f28eaadd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:16.056638 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b64880d1-3ee6-4754-99cd-e655f28eaadd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:16.233216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b64880d1-3ee6-4754-99cd-e655f28eaadd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:16.242035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b64880d1-3ee6-4754-99cd-e655f28eaadd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:16.243491 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b64880d1-3ee6-4754-99cd-e655f28eaadd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:16.246293 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b64880d1-3ee6-4754-99cd-e655f28eaadd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.204594 Sep 16 08:07:16.246928 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 126/231] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:16 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:16.809930 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-92feedef-42fd-468e-8d1d-f8f5cd997dc2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:16.810854 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-92feedef-42fd-468e-8d1d-f8f5cd997dc2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:16.819277 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-92feedef-42fd-468e-8d1d-f8f5cd997dc2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:16.821117 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-92feedef-42fd-468e-8d1d-f8f5cd997dc2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:16.821600 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-92feedef-42fd-468e-8d1d-f8f5cd997dc2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:16.822357 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-92feedef-42fd-468e-8d1d-f8f5cd997dc2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:16.822916 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-92feedef-42fd-468e-8d1d-f8f5cd997dc2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:16.823299 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-92feedef-42fd-468e-8d1d-f8f5cd997dc2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:16.977974 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-92feedef-42fd-468e-8d1d-f8f5cd997dc2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:16.987213 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-92feedef-42fd-468e-8d1d-f8f5cd997dc2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.181051 Sep 16 08:07:16.987935 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 106/232] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:16 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:17.286371 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-97cb4a46-0cf9-45e3-bad6-b4690a0853e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:17.287020 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-97cb4a46-0cf9-45e3-bad6-b4690a0853e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:17.295984 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-97cb4a46-0cf9-45e3-bad6-b4690a0853e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:17.299322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-97cb4a46-0cf9-45e3-bad6-b4690a0853e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:17.300041 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-97cb4a46-0cf9-45e3-bad6-b4690a0853e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:17.301218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-97cb4a46-0cf9-45e3-bad6-b4690a0853e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:17.302819 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-97cb4a46-0cf9-45e3-bad6-b4690a0853e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:17.306649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-97cb4a46-0cf9-45e3-bad6-b4690a0853e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:17.482088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6ad6bed6-e932-429d-b668-59d122f9c1df tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Action: 'create', calling method: .version_select at 0x7f9d06d2f160>, body: {"keypair": {"name": "tempest-TestMinimumBasicScenario-577618645", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIeoPD+5iJNMvzZySGldv9URk95HivxmU/q389/Lg8fLQZQh16DMqoXteixHknKk/sjckqwslnl+g93YN8UjA/5UU1BW0VGDmxlJtLPDhWfyluWGGwoA/xQRLfmYWsiPXw=="}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:17.499304 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-6ad6bed6-e932-429d-b668-59d122f9c1df tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Getting quotas for project 5870af1bbad64b138178c47e4a571d81. Resources: {'key_pairs'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:07:17.505070 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-6ad6bed6-e932-429d-b668-59d122f9c1df tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Getting quotas for user 66702831c1ca4158976920f6be2cc80c and project 5870af1bbad64b138178c47e4a571d81. Resources: {'key_pairs'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:07:17.520128 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-97cb4a46-0cf9-45e3-bad6-b4690a0853e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:17.530872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-97cb4a46-0cf9-45e3-bad6-b4690a0853e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:17.532563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-97cb4a46-0cf9-45e3-bad6-b4690a0853e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:17.533994 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-97cb4a46-0cf9-45e3-bad6-b4690a0853e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.252534 Sep 16 08:07:17.538713 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 127/233] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:17 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:17.631760 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6ad6bed6-e932-429d-b668-59d122f9c1df tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 402 microversion: 2.1 time: 0.153452 Sep 16 08:07:17.632365 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 107/234] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Sep 16 08:07:17 2022] POST /compute/v2.1/os-keypairs => generated 402 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:07:17.756433 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestMinimumBasicScenario-server-1607299420", "imageRef": "81e86808-8585-426c-870a-7ba3f862cd35", "flavorRef": "452", "key_name": "tempest-TestMinimumBasicScenario-577618645", "networks": [{"uuid": "8da3cc5f-f2f9-43ac-8827-97d0d1518146"}]}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:17.817037 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.network.neutron [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] validate_networks() for [('8da3cc5f-f2f9-43ac-8827-97d0d1518146', None, None, None, None, None)] {{(pid=121046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:07:18.013270 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1b2d1927-c6f8-4dea-94f9-bb5b9303c436 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:18.013965 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1b2d1927-c6f8-4dea-94f9-bb5b9303c436 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:18.020184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1b2d1927-c6f8-4dea-94f9-bb5b9303c436 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:18.020778 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1b2d1927-c6f8-4dea-94f9-bb5b9303c436 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:18.021277 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1b2d1927-c6f8-4dea-94f9-bb5b9303c436 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:18.022099 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1b2d1927-c6f8-4dea-94f9-bb5b9303c436 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:18.022611 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1b2d1927-c6f8-4dea-94f9-bb5b9303c436 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:18.023074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1b2d1927-c6f8-4dea-94f9-bb5b9303c436 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:18.192937 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1b2d1927-c6f8-4dea-94f9-bb5b9303c436 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:18.200926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1b2d1927-c6f8-4dea-94f9-bb5b9303c436 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.192929 Sep 16 08:07:18.201604 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 108/235] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:18 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:18.241429 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Flavor limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:07:18.241857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Image limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:07:18.242332 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Flavor pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:07:18.242774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Image pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:07:18.243188 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:07:18.252587 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:18.253070 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:18.253570 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:18.254901 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:18.255379 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:18.255816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:18.273578 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Getting quotas for project 5870af1bbad64b138178c47e4a571d81. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:07:18.277681 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Getting quotas for user 66702831c1ca4158976920f6be2cc80c and project 5870af1bbad64b138178c47e4a571d81. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:07:18.288873 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Going to run 1 instances... {{(pid=121046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:07:18.291144 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='81e86808-8585-426c-870a-7ba3f862cd35',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:07:18.425232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-8e155176-00fe-4b4f-b93c-2deccfcbeeb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: .version_select at 0x7f9d06e92ee0>, body: {"keypair": {"name": "tempest-keypair-1410487216", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBAyvi1YDCbCB42pcwBOwJbSb/jKozZEjfeA8YKShNZV79N3GDI/2kHUIiSikkI6RT6oUO+vZWtLxC1tmYLzRl2kTxS0dtyrzfrbeCHhwlWu+slmLiltX7vRWnNIEng4BwQ=="}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:18.454416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-8e155176-00fe-4b4f-b93c-2deccfcbeeb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for project b807736ef6c54be2b4715f32a4cfea57. Resources: {'key_pairs'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:07:18.462984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-8e155176-00fe-4b4f-b93c-2deccfcbeeb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for user ea2f6b804e164dbcb4f67926f23fdd59 and project b807736ef6c54be2b4715f32a4cfea57. Resources: {'key_pairs'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:07:18.478050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-bb49885c-fd1b-43a3-a3e6-c91b41b3bab8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.726986 Sep 16 08:07:18.480686 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 128/236] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:07:17 2022] POST /compute/v2.1/servers => generated 380 bytes in 730 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:07:18.502717 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-bd673ccd-7719-4051-b141-1a3fb66f2160 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:18.503367 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-bd673ccd-7719-4051-b141-1a3fb66f2160 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:18.564442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-bd673ccd-7719-4051-b141-1a3fb66f2160 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:18.590026 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-8e155176-00fe-4b4f-b93c-2deccfcbeeb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.168975 Sep 16 08:07:18.591464 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 109/237] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Sep 16 08:07:18 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:07:18.599473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2b358d99-a93e-4104-8044-c2172b790d65 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:18.600219 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2b358d99-a93e-4104-8044-c2172b790d65 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:18.607225 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2b358d99-a93e-4104-8044-c2172b790d65 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:18.607638 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2b358d99-a93e-4104-8044-c2172b790d65 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:18.608227 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2b358d99-a93e-4104-8044-c2172b790d65 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:18.609107 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2b358d99-a93e-4104-8044-c2172b790d65 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:18.609730 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2b358d99-a93e-4104-8044-c2172b790d65 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:18.610482 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2b358d99-a93e-4104-8044-c2172b790d65 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:18.759973 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-bd673ccd-7719-4051-b141-1a3fb66f2160 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1258 microversion: 2.1 time: 0.261163 Sep 16 08:07:18.774707 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 129/238] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:18 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1258 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:18.963615 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2b358d99-a93e-4104-8044-c2172b790d65 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:18.971772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2b358d99-a93e-4104-8044-c2172b790d65 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:18.973997 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2b358d99-a93e-4104-8044-c2172b790d65 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:18.975257 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2b358d99-a93e-4104-8044-c2172b790d65 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.382565 Sep 16 08:07:18.976202 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 110/239] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:18 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 384 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:19.223479 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7aef2b2e-f24e-48e0-bf99-62c41a6c977e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:19.224097 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7aef2b2e-f24e-48e0-bf99-62c41a6c977e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:19.230085 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7aef2b2e-f24e-48e0-bf99-62c41a6c977e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:19.230569 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7aef2b2e-f24e-48e0-bf99-62c41a6c977e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:19.231040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7aef2b2e-f24e-48e0-bf99-62c41a6c977e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:19.231732 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7aef2b2e-f24e-48e0-bf99-62c41a6c977e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:19.232187 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7aef2b2e-f24e-48e0-bf99-62c41a6c977e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:19.232615 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7aef2b2e-f24e-48e0-bf99-62c41a6c977e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:19.398945 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7aef2b2e-f24e-48e0-bf99-62c41a6c977e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:19.407641 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7aef2b2e-f24e-48e0-bf99-62c41a6c977e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.188161 Sep 16 08:07:19.408526 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 130/240] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:19 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 190 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:19.783841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d2e1414f-5176-4834-a6e5-a0425070236e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:19.784730 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d2e1414f-5176-4834-a6e5-a0425070236e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:19.842820 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d2e1414f-5176-4834-a6e5-a0425070236e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:19.850231 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d2e1414f-5176-4834-a6e5-a0425070236e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1258 microversion: 2.1 time: 0.070713 Sep 16 08:07:19.850828 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 111/241] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:19 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1258 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:19.999767 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dd866868-4071-489f-84cf-6d07b8f2acb1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:20.000368 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dd866868-4071-489f-84cf-6d07b8f2acb1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:20.006516 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd866868-4071-489f-84cf-6d07b8f2acb1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:20.007065 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd866868-4071-489f-84cf-6d07b8f2acb1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:20.007493 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd866868-4071-489f-84cf-6d07b8f2acb1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:20.008189 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd866868-4071-489f-84cf-6d07b8f2acb1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:20.008637 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd866868-4071-489f-84cf-6d07b8f2acb1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:20.009056 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd866868-4071-489f-84cf-6d07b8f2acb1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:20.221186 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dd866868-4071-489f-84cf-6d07b8f2acb1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:20.229988 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dd866868-4071-489f-84cf-6d07b8f2acb1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:20.231557 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dd866868-4071-489f-84cf-6d07b8f2acb1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:20.232665 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dd866868-4071-489f-84cf-6d07b8f2acb1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.236950 Sep 16 08:07:20.233225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 131/242] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:19 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:20.431270 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-104ecdcc-b221-4139-9d31-41835793e031 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:20.431888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-104ecdcc-b221-4139-9d31-41835793e031 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:20.437908 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-104ecdcc-b221-4139-9d31-41835793e031 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:20.438451 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-104ecdcc-b221-4139-9d31-41835793e031 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:20.438922 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-104ecdcc-b221-4139-9d31-41835793e031 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:20.439610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-104ecdcc-b221-4139-9d31-41835793e031 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:20.440057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-104ecdcc-b221-4139-9d31-41835793e031 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:20.440481 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-104ecdcc-b221-4139-9d31-41835793e031 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:20.614015 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-104ecdcc-b221-4139-9d31-41835793e031 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:20.623621 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-104ecdcc-b221-4139-9d31-41835793e031 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.196367 Sep 16 08:07:20.635058 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 112/243] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:20 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:20.873416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-baf1a80a-57ae-49f7-aedd-e05eca544879 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:20.874024 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-baf1a80a-57ae-49f7-aedd-e05eca544879 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:20.881621 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-baf1a80a-57ae-49f7-aedd-e05eca544879 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:20.882104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-baf1a80a-57ae-49f7-aedd-e05eca544879 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:20.882537 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-baf1a80a-57ae-49f7-aedd-e05eca544879 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:20.883249 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-baf1a80a-57ae-49f7-aedd-e05eca544879 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:20.883698 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-baf1a80a-57ae-49f7-aedd-e05eca544879 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:20.884115 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-baf1a80a-57ae-49f7-aedd-e05eca544879 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:20.974787 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-baf1a80a-57ae-49f7-aedd-e05eca544879 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:20.982499 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-baf1a80a-57ae-49f7-aedd-e05eca544879 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1262 microversion: 2.1 time: 0.113137 Sep 16 08:07:20.983370 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 132/244] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:20 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1262 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:21.227804 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-67328661", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08ca5f04-b5f0-4538-b476-9e48665ae12b"}], "security_groups": [{"name": "tempest-securitygroup--1458352214"}], "key_name": "tempest-keypair-1410487216", "user_data": "}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:21.236547 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=87,nova_api:INSERT=5 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:21.257845 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dd7ef0ef-5534-46c7-8114-0e9c812e062d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:21.258450 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dd7ef0ef-5534-46c7-8114-0e9c812e062d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:21.264373 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd7ef0ef-5534-46c7-8114-0e9c812e062d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:21.264852 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd7ef0ef-5534-46c7-8114-0e9c812e062d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:21.265291 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd7ef0ef-5534-46c7-8114-0e9c812e062d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:21.265966 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd7ef0ef-5534-46c7-8114-0e9c812e062d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:21.266416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd7ef0ef-5534-46c7-8114-0e9c812e062d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:21.266868 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd7ef0ef-5534-46c7-8114-0e9c812e062d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:21.332637 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.network.neutron [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] validate_networks() for [('08ca5f04-b5f0-4538-b476-9e48665ae12b', None, None, None, None, None)] {{(pid=121047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:07:21.419665 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dd7ef0ef-5534-46c7-8114-0e9c812e062d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:21.430508 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dd7ef0ef-5534-46c7-8114-0e9c812e062d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:21.432051 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dd7ef0ef-5534-46c7-8114-0e9c812e062d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:21.433181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dd7ef0ef-5534-46c7-8114-0e9c812e062d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.179840 Sep 16 08:07:21.433908 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 133/245] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:21 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:07:21.647301 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-735023ec-9def-49df-80d5-48fa46c00e3d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:21.647923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-735023ec-9def-49df-80d5-48fa46c00e3d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:21.655650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-735023ec-9def-49df-80d5-48fa46c00e3d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:21.656806 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-735023ec-9def-49df-80d5-48fa46c00e3d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:21.658488 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-735023ec-9def-49df-80d5-48fa46c00e3d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:21.660419 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-735023ec-9def-49df-80d5-48fa46c00e3d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:21.660954 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-735023ec-9def-49df-80d5-48fa46c00e3d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:21.661930 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-735023ec-9def-49df-80d5-48fa46c00e3d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:21.793260 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Flavor limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:07:21.793814 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Image limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:07:21.794400 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Flavor pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:07:21.795019 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Image pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:07:21.795537 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:07:21.811408 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:21.811985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:21.812447 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:21.813468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:21.814107 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:21.816074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:21.822145 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-735023ec-9def-49df-80d5-48fa46c00e3d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:21.832759 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-735023ec-9def-49df-80d5-48fa46c00e3d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.189041 Sep 16 08:07:21.837883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 134/246] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:21 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:21.843273 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for project b807736ef6c54be2b4715f32a4cfea57. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:07:21.849347 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for user ea2f6b804e164dbcb4f67926f23fdd59 and project b807736ef6c54be2b4715f32a4cfea57. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:07:21.863140 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Going to run 1 instances... {{(pid=121047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:07:21.869861 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:07:22.005547 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-924d297a-9cfc-4700-985d-d1d3ce1d38d8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:22.006639 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-924d297a-9cfc-4700-985d-d1d3ce1d38d8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:22.037362 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-924d297a-9cfc-4700-985d-d1d3ce1d38d8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:22.038144 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-924d297a-9cfc-4700-985d-d1d3ce1d38d8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:22.038760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-924d297a-9cfc-4700-985d-d1d3ce1d38d8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:22.042157 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-924d297a-9cfc-4700-985d-d1d3ce1d38d8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:22.042811 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-924d297a-9cfc-4700-985d-d1d3ce1d38d8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:22.043888 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-924d297a-9cfc-4700-985d-d1d3ce1d38d8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:22.051142 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-86bc3c5e-5ac0-43fa-9215-ad58e5489db9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 0.827484 Sep 16 08:07:22.054565 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 113/247] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:07:21 2022] POST /compute/v2.1/servers => generated 402 bytes in 831 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:07:22.065811 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-62a2526e-e395-42b8-a577-d41afbbdc1ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:22.066665 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-62a2526e-e395-42b8-a577-d41afbbdc1ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:22.142368 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-924d297a-9cfc-4700-985d-d1d3ce1d38d8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:22.152562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-924d297a-9cfc-4700-985d-d1d3ce1d38d8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1262 microversion: 2.1 time: 0.151533 Sep 16 08:07:22.156333 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 135/248] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:21 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1262 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:22.178517 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-62a2526e-e395-42b8-a577-d41afbbdc1ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:22.187441 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-62a2526e-e395-42b8-a577-d41afbbdc1ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1240 microversion: 2.1 time: 0.125744 Sep 16 08:07:22.188252 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 114/249] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:22 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1240 bytes in 127 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:22.462084 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-98e1561e-0d83-4f71-ac3f-578f2b7493ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:22.462844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-98e1561e-0d83-4f71-ac3f-578f2b7493ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:22.473080 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-98e1561e-0d83-4f71-ac3f-578f2b7493ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:22.473715 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-98e1561e-0d83-4f71-ac3f-578f2b7493ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:22.474236 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-98e1561e-0d83-4f71-ac3f-578f2b7493ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:22.475058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-98e1561e-0d83-4f71-ac3f-578f2b7493ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:22.476085 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-98e1561e-0d83-4f71-ac3f-578f2b7493ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:22.476745 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-98e1561e-0d83-4f71-ac3f-578f2b7493ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:22.670985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-98e1561e-0d83-4f71-ac3f-578f2b7493ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:22.677756 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-98e1561e-0d83-4f71-ac3f-578f2b7493ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:22.679937 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-98e1561e-0d83-4f71-ac3f-578f2b7493ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:22.681605 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-98e1561e-0d83-4f71-ac3f-578f2b7493ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.227114 Sep 16 08:07:22.683608 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 136/250] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:22 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 230 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:22.856660 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2658c712-f826-45b6-874b-d5453d6513b3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:22.857258 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2658c712-f826-45b6-874b-d5453d6513b3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:22.866112 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2658c712-f826-45b6-874b-d5453d6513b3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:22.866604 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2658c712-f826-45b6-874b-d5453d6513b3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:22.867070 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2658c712-f826-45b6-874b-d5453d6513b3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:22.870537 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2658c712-f826-45b6-874b-d5453d6513b3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:22.871031 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2658c712-f826-45b6-874b-d5453d6513b3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:22.883415 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2658c712-f826-45b6-874b-d5453d6513b3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.012s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:23.040230 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2658c712-f826-45b6-874b-d5453d6513b3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:23.049527 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2658c712-f826-45b6-874b-d5453d6513b3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.196694 Sep 16 08:07:23.050181 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 115/251] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:22 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:23.178597 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e3206c20-93d9-43bf-bea2-3a9e53a16355 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:23.179243 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e3206c20-93d9-43bf-bea2-3a9e53a16355 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:23.185670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e3206c20-93d9-43bf-bea2-3a9e53a16355 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:23.186159 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e3206c20-93d9-43bf-bea2-3a9e53a16355 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:23.186645 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e3206c20-93d9-43bf-bea2-3a9e53a16355 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:23.187406 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e3206c20-93d9-43bf-bea2-3a9e53a16355 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:23.187909 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e3206c20-93d9-43bf-bea2-3a9e53a16355 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:23.188411 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e3206c20-93d9-43bf-bea2-3a9e53a16355 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:23.213374 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-bbbdf38b-7ce2-41d6-8cca-ed8dbcf19d6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:23.213987 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-bbbdf38b-7ce2-41d6-8cca-ed8dbcf19d6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:23.220249 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bbbdf38b-7ce2-41d6-8cca-ed8dbcf19d6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:23.224969 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bbbdf38b-7ce2-41d6-8cca-ed8dbcf19d6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:23.224969 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bbbdf38b-7ce2-41d6-8cca-ed8dbcf19d6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:23.224969 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bbbdf38b-7ce2-41d6-8cca-ed8dbcf19d6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:23.224969 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bbbdf38b-7ce2-41d6-8cca-ed8dbcf19d6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:23.225306 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bbbdf38b-7ce2-41d6-8cca-ed8dbcf19d6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:23.239295 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:23.249743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e3206c20-93d9-43bf-bea2-3a9e53a16355 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:23.257519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e3206c20-93d9-43bf-bea2-3a9e53a16355 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1310 microversion: 2.1 time: 0.083389 Sep 16 08:07:23.258092 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 137/252] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:23 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1310 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:23.287193 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-bbbdf38b-7ce2-41d6-8cca-ed8dbcf19d6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:23.294776 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-bbbdf38b-7ce2-41d6-8cca-ed8dbcf19d6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1244 microversion: 2.1 time: 0.085320 Sep 16 08:07:23.295342 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 116/253] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:23 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1244 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:23.709246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d5e344ef-d99a-4b27-960b-8faa836cdded tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:23.709936 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d5e344ef-d99a-4b27-960b-8faa836cdded tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:23.716154 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5e344ef-d99a-4b27-960b-8faa836cdded tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:23.716814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5e344ef-d99a-4b27-960b-8faa836cdded tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:23.717249 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5e344ef-d99a-4b27-960b-8faa836cdded tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:23.721564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5e344ef-d99a-4b27-960b-8faa836cdded tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:23.721564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5e344ef-d99a-4b27-960b-8faa836cdded tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:23.721564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5e344ef-d99a-4b27-960b-8faa836cdded tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:23.721564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:23.890736 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d5e344ef-d99a-4b27-960b-8faa836cdded tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:23.902022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d5e344ef-d99a-4b27-960b-8faa836cdded tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:23.903823 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d5e344ef-d99a-4b27-960b-8faa836cdded tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:23.905650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d5e344ef-d99a-4b27-960b-8faa836cdded tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.200845 Sep 16 08:07:23.906872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 138/254] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:23 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:24.015507 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-2c14b933-4550-40ae-a91d-fe2312ee0b0d req-18247460-d706-4d2b-97df-18e5d1fc377d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c", "name": "network-vif-plugged", "status": "completed", "tag": "0104ad2b-b1c9-455f-a512-cdc1dd34408e"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:24.028103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-2c14b933-4550-40ae-a91d-fe2312ee0b0d req-18247460-d706-4d2b-97df-18e5d1fc377d service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:24.028622 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-2c14b933-4550-40ae-a91d-fe2312ee0b0d req-18247460-d706-4d2b-97df-18e5d1fc377d service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:24.029055 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-2c14b933-4550-40ae-a91d-fe2312ee0b0d req-18247460-d706-4d2b-97df-18e5d1fc377d service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:24.041408 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-2c14b933-4550-40ae-a91d-fe2312ee0b0d req-18247460-d706-4d2b-97df-18e5d1fc377d service nova] Creating event network-vif-plugged:0104ad2b-b1c9-455f-a512-cdc1dd34408e for instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c on hv-cinder-74014 Sep 16 08:07:24.046717 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-2c14b933-4550-40ae-a91d-fe2312ee0b0d req-18247460-d706-4d2b-97df-18e5d1fc377d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.036288 Sep 16 08:07:24.047329 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 117/255] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:07:24 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:07:24.073567 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7ec232d0-32d6-42d1-ac5a-3e7d6955574a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:24.074170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7ec232d0-32d6-42d1-ac5a-3e7d6955574a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:24.080015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7ec232d0-32d6-42d1-ac5a-3e7d6955574a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:24.080508 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7ec232d0-32d6-42d1-ac5a-3e7d6955574a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:24.080938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7ec232d0-32d6-42d1-ac5a-3e7d6955574a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:24.082265 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7ec232d0-32d6-42d1-ac5a-3e7d6955574a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:24.082752 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7ec232d0-32d6-42d1-ac5a-3e7d6955574a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:24.083175 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7ec232d0-32d6-42d1-ac5a-3e7d6955574a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:24.271594 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7ec232d0-32d6-42d1-ac5a-3e7d6955574a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:24.280331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7ec232d0-32d6-42d1-ac5a-3e7d6955574a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.210485 Sep 16 08:07:24.283779 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 139/256] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:24 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:24.285809 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-96ffa22f-3e72-455e-a347-403128410a37 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:24.286517 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-96ffa22f-3e72-455e-a347-403128410a37 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:24.304978 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-96ffa22f-3e72-455e-a347-403128410a37 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:24.306010 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-96ffa22f-3e72-455e-a347-403128410a37 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:24.311277 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-96ffa22f-3e72-455e-a347-403128410a37 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:24.311277 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-96ffa22f-3e72-455e-a347-403128410a37 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:24.311277 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-96ffa22f-3e72-455e-a347-403128410a37 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:24.311277 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-96ffa22f-3e72-455e-a347-403128410a37 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:24.317425 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ff58b7b2-ea89-43e3-8e6d-a32ff3837fb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:24.318029 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ff58b7b2-ea89-43e3-8e6d-a32ff3837fb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:24.324644 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff58b7b2-ea89-43e3-8e6d-a32ff3837fb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:24.325328 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff58b7b2-ea89-43e3-8e6d-a32ff3837fb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:24.325952 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff58b7b2-ea89-43e3-8e6d-a32ff3837fb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:24.326826 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff58b7b2-ea89-43e3-8e6d-a32ff3837fb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:24.327423 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff58b7b2-ea89-43e3-8e6d-a32ff3837fb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:24.327994 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff58b7b2-ea89-43e3-8e6d-a32ff3837fb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:24.402503 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ff58b7b2-ea89-43e3-8e6d-a32ff3837fb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:24.409038 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-96ffa22f-3e72-455e-a347-403128410a37 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:24.427172 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ff58b7b2-ea89-43e3-8e6d-a32ff3837fb9 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1236 microversion: 2.1 time: 0.113692 Sep 16 08:07:24.428077 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 140/257] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:24 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1236 bytes in 115 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:24.449041 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-96ffa22f-3e72-455e-a347-403128410a37 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1328 microversion: 2.1 time: 0.168283 Sep 16 08:07:24.452407 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 118/258] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:24 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1328 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:24.932500 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0c7ebbea-67e1-4b4b-87f3-e18bf1d95269 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:24.933121 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0c7ebbea-67e1-4b4b-87f3-e18bf1d95269 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:24.939846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0c7ebbea-67e1-4b4b-87f3-e18bf1d95269 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:24.940335 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0c7ebbea-67e1-4b4b-87f3-e18bf1d95269 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:24.941626 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0c7ebbea-67e1-4b4b-87f3-e18bf1d95269 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:24.945689 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0c7ebbea-67e1-4b4b-87f3-e18bf1d95269 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:24.946169 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0c7ebbea-67e1-4b4b-87f3-e18bf1d95269 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:24.947032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0c7ebbea-67e1-4b4b-87f3-e18bf1d95269 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:25.154494 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0c7ebbea-67e1-4b4b-87f3-e18bf1d95269 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:25.164013 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0c7ebbea-67e1-4b4b-87f3-e18bf1d95269 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:25.165790 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0c7ebbea-67e1-4b4b-87f3-e18bf1d95269 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:25.168996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0c7ebbea-67e1-4b4b-87f3-e18bf1d95269 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.238731 Sep 16 08:07:25.168996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 141/259] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:24 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:25.308003 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-298e5c1d-8410-4d21-a345-6fbb18f0e48b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:25.308616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-298e5c1d-8410-4d21-a345-6fbb18f0e48b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:25.315135 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e5c1d-8410-4d21-a345-6fbb18f0e48b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:25.315644 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e5c1d-8410-4d21-a345-6fbb18f0e48b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:25.316084 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e5c1d-8410-4d21-a345-6fbb18f0e48b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:25.316784 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e5c1d-8410-4d21-a345-6fbb18f0e48b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:25.317238 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e5c1d-8410-4d21-a345-6fbb18f0e48b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:25.317670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e5c1d-8410-4d21-a345-6fbb18f0e48b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:25.454446 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-bae21dc0-dcd0-44ad-8ae1-a71733a6d103 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:25.455709 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-bae21dc0-dcd0-44ad-8ae1-a71733a6d103 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:25.468836 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bae21dc0-dcd0-44ad-8ae1-a71733a6d103 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:25.469667 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bae21dc0-dcd0-44ad-8ae1-a71733a6d103 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:25.470296 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bae21dc0-dcd0-44ad-8ae1-a71733a6d103 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:25.474957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bae21dc0-dcd0-44ad-8ae1-a71733a6d103 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:25.475993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bae21dc0-dcd0-44ad-8ae1-a71733a6d103 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:25.477762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bae21dc0-dcd0-44ad-8ae1-a71733a6d103 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:25.512133 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-298e5c1d-8410-4d21-a345-6fbb18f0e48b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:25.524365 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-298e5c1d-8410-4d21-a345-6fbb18f0e48b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.220226 Sep 16 08:07:25.525646 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 119/260] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:25 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:25.531269 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a0d6bb00-a4e6-4b2c-9aee-d8b5b21edde3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:25.532197 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a0d6bb00-a4e6-4b2c-9aee-d8b5b21edde3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:25.540595 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a0d6bb00-a4e6-4b2c-9aee-d8b5b21edde3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:25.541288 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a0d6bb00-a4e6-4b2c-9aee-d8b5b21edde3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:25.541893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a0d6bb00-a4e6-4b2c-9aee-d8b5b21edde3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:25.542605 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a0d6bb00-a4e6-4b2c-9aee-d8b5b21edde3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:25.543211 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a0d6bb00-a4e6-4b2c-9aee-d8b5b21edde3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:25.543652 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a0d6bb00-a4e6-4b2c-9aee-d8b5b21edde3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:25.581950 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-bae21dc0-dcd0-44ad-8ae1-a71733a6d103 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:25.590122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-bae21dc0-dcd0-44ad-8ae1-a71733a6d103 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.140199 Sep 16 08:07:25.590821 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 142/261] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:25 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 142 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:25.677959 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a0d6bb00-a4e6-4b2c-9aee-d8b5b21edde3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:25.685674 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a0d6bb00-a4e6-4b2c-9aee-d8b5b21edde3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.158783 Sep 16 08:07:25.686252 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 120/262] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:25 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:26.195229 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dbfdccaa-ad45-4c72-88ee-31cc6bb7c72d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:26.196024 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dbfdccaa-ad45-4c72-88ee-31cc6bb7c72d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:26.202307 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dbfdccaa-ad45-4c72-88ee-31cc6bb7c72d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:26.202822 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dbfdccaa-ad45-4c72-88ee-31cc6bb7c72d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:26.203263 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dbfdccaa-ad45-4c72-88ee-31cc6bb7c72d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:26.203958 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dbfdccaa-ad45-4c72-88ee-31cc6bb7c72d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:26.204459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dbfdccaa-ad45-4c72-88ee-31cc6bb7c72d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:26.204911 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dbfdccaa-ad45-4c72-88ee-31cc6bb7c72d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:26.376412 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dbfdccaa-ad45-4c72-88ee-31cc6bb7c72d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:26.385792 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dbfdccaa-ad45-4c72-88ee-31cc6bb7c72d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:26.387413 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dbfdccaa-ad45-4c72-88ee-31cc6bb7c72d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:26.388516 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dbfdccaa-ad45-4c72-88ee-31cc6bb7c72d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.199921 Sep 16 08:07:26.390291 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 143/263] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:26 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:26.551327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3c00480e-7641-4cbc-ae96-724e616ebd93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:26.552202 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3c00480e-7641-4cbc-ae96-724e616ebd93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:26.559749 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3c00480e-7641-4cbc-ae96-724e616ebd93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:26.560245 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3c00480e-7641-4cbc-ae96-724e616ebd93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:26.560862 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3c00480e-7641-4cbc-ae96-724e616ebd93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:26.561680 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3c00480e-7641-4cbc-ae96-724e616ebd93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:26.562832 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3c00480e-7641-4cbc-ae96-724e616ebd93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:26.563272 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3c00480e-7641-4cbc-ae96-724e616ebd93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:26.614280 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0de33a30-06e1-416e-8248-44d3fcebd27a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:26.614913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0de33a30-06e1-416e-8248-44d3fcebd27a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:26.621377 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0de33a30-06e1-416e-8248-44d3fcebd27a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:26.621858 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0de33a30-06e1-416e-8248-44d3fcebd27a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:26.622292 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0de33a30-06e1-416e-8248-44d3fcebd27a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:26.623013 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0de33a30-06e1-416e-8248-44d3fcebd27a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:26.623499 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0de33a30-06e1-416e-8248-44d3fcebd27a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:26.623922 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0de33a30-06e1-416e-8248-44d3fcebd27a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:26.690526 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0de33a30-06e1-416e-8248-44d3fcebd27a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:26.698803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0de33a30-06e1-416e-8248-44d3fcebd27a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.089152 Sep 16 08:07:26.699502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 144/264] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:26 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:26.709812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3c00480e-7641-4cbc-ae96-724e616ebd93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:26.711494 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-77879026-4d90-46b5-8438-8e2e4b06db7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:26.712108 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-77879026-4d90-46b5-8438-8e2e4b06db7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:26.718082 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77879026-4d90-46b5-8438-8e2e4b06db7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:26.718332 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3c00480e-7641-4cbc-ae96-724e616ebd93 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.172379 Sep 16 08:07:26.718559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77879026-4d90-46b5-8438-8e2e4b06db7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:26.719026 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77879026-4d90-46b5-8438-8e2e4b06db7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:26.719160 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 121/265] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:26 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:26.719996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77879026-4d90-46b5-8438-8e2e4b06db7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:26.720451 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77879026-4d90-46b5-8438-8e2e4b06db7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:26.720875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77879026-4d90-46b5-8438-8e2e4b06db7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:26.860896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-77879026-4d90-46b5-8438-8e2e4b06db7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:26.869370 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-77879026-4d90-46b5-8438-8e2e4b06db7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.161767 Sep 16 08:07:26.870095 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 145/266] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:26 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:27.413494 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b9d1c683-615c-4413-883a-6cb91363765a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:27.414193 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b9d1c683-615c-4413-883a-6cb91363765a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:27.420080 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b9d1c683-615c-4413-883a-6cb91363765a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:27.420566 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b9d1c683-615c-4413-883a-6cb91363765a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:27.421006 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b9d1c683-615c-4413-883a-6cb91363765a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:27.421701 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b9d1c683-615c-4413-883a-6cb91363765a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:27.422155 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b9d1c683-615c-4413-883a-6cb91363765a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:27.422588 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b9d1c683-615c-4413-883a-6cb91363765a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:27.589368 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b9d1c683-615c-4413-883a-6cb91363765a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:27.597998 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b9d1c683-615c-4413-883a-6cb91363765a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:27.599551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b9d1c683-615c-4413-883a-6cb91363765a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:27.600661 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b9d1c683-615c-4413-883a-6cb91363765a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.191094 Sep 16 08:07:27.601221 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 122/267] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:27 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:27.721657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-00d58783-ed0f-43a0-bdb0-3987250603c8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:27.722360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-00d58783-ed0f-43a0-bdb0-3987250603c8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:27.728635 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00d58783-ed0f-43a0-bdb0-3987250603c8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:27.729117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00d58783-ed0f-43a0-bdb0-3987250603c8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:27.729554 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00d58783-ed0f-43a0-bdb0-3987250603c8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:27.730248 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00d58783-ed0f-43a0-bdb0-3987250603c8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:27.731365 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00d58783-ed0f-43a0-bdb0-3987250603c8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:27.731790 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00d58783-ed0f-43a0-bdb0-3987250603c8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:27.744969 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1a8bdbea-d328-4ec0-b996-2f8a8d6ba72b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:27.745573 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1a8bdbea-d328-4ec0-b996-2f8a8d6ba72b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:27.751920 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1a8bdbea-d328-4ec0-b996-2f8a8d6ba72b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:27.752408 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1a8bdbea-d328-4ec0-b996-2f8a8d6ba72b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:27.752840 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1a8bdbea-d328-4ec0-b996-2f8a8d6ba72b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:27.754294 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1a8bdbea-d328-4ec0-b996-2f8a8d6ba72b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:27.754767 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1a8bdbea-d328-4ec0-b996-2f8a8d6ba72b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:27.755195 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1a8bdbea-d328-4ec0-b996-2f8a8d6ba72b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:27.798774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-00d58783-ed0f-43a0-bdb0-3987250603c8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:27.807220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-00d58783-ed0f-43a0-bdb0-3987250603c8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.089340 Sep 16 08:07:27.807802 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 146/268] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:27 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:27.892361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1a8bdbea-d328-4ec0-b996-2f8a8d6ba72b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:27.893234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7ccef08c-0857-4104-9106-6bf8363c1f7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:27.894001 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7ccef08c-0857-4104-9106-6bf8363c1f7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:27.900146 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1a8bdbea-d328-4ec0-b996-2f8a8d6ba72b tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.159754 Sep 16 08:07:27.900897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 123/269] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:27 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:27.903835 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7ccef08c-0857-4104-9106-6bf8363c1f7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:27.903835 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7ccef08c-0857-4104-9106-6bf8363c1f7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:27.903835 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7ccef08c-0857-4104-9106-6bf8363c1f7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:27.903835 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7ccef08c-0857-4104-9106-6bf8363c1f7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:27.904332 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7ccef08c-0857-4104-9106-6bf8363c1f7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:27.904332 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7ccef08c-0857-4104-9106-6bf8363c1f7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:28.037685 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7ccef08c-0857-4104-9106-6bf8363c1f7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:28.045476 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7ccef08c-0857-4104-9106-6bf8363c1f7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.156730 Sep 16 08:07:28.046041 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 147/270] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:27 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:28.625375 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-95fd92a5-bc07-4e32-9c0a-90733658aed6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:28.625986 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-95fd92a5-bc07-4e32-9c0a-90733658aed6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:28.632383 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95fd92a5-bc07-4e32-9c0a-90733658aed6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:28.632869 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95fd92a5-bc07-4e32-9c0a-90733658aed6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:28.633304 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95fd92a5-bc07-4e32-9c0a-90733658aed6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:28.634003 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95fd92a5-bc07-4e32-9c0a-90733658aed6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:28.634453 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95fd92a5-bc07-4e32-9c0a-90733658aed6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:28.634913 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95fd92a5-bc07-4e32-9c0a-90733658aed6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:28.783092 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-95fd92a5-bc07-4e32-9c0a-90733658aed6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:28.793682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-95fd92a5-bc07-4e32-9c0a-90733658aed6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:28.795683 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-95fd92a5-bc07-4e32-9c0a-90733658aed6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:28.797129 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-95fd92a5-bc07-4e32-9c0a-90733658aed6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.175794 Sep 16 08:07:28.812704 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 124/271] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:28 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:28.829551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dc614665-a313-4b6c-ac41-ac58603c9bcd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:28.830246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dc614665-a313-4b6c-ac41-ac58603c9bcd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:28.832794 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:28.833571 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=8 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:28.839293 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc614665-a313-4b6c-ac41-ac58603c9bcd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:28.840015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc614665-a313-4b6c-ac41-ac58603c9bcd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:28.840605 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc614665-a313-4b6c-ac41-ac58603c9bcd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:28.841462 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc614665-a313-4b6c-ac41-ac58603c9bcd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:28.842064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc614665-a313-4b6c-ac41-ac58603c9bcd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:28.842657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc614665-a313-4b6c-ac41-ac58603c9bcd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:28.916421 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dc614665-a313-4b6c-ac41-ac58603c9bcd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:28.927034 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dc614665-a313-4b6c-ac41-ac58603c9bcd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.101400 Sep 16 08:07:28.928117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 148/272] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:28 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:28.928847 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-dc6c52d9-2f65-4ffe-adc4-1ad6a5208e18 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:28.929461 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-dc6c52d9-2f65-4ffe-adc4-1ad6a5208e18 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:28.943949 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dc6c52d9-2f65-4ffe-adc4-1ad6a5208e18 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:28.944540 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dc6c52d9-2f65-4ffe-adc4-1ad6a5208e18 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:28.944979 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dc6c52d9-2f65-4ffe-adc4-1ad6a5208e18 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:28.945709 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dc6c52d9-2f65-4ffe-adc4-1ad6a5208e18 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:28.946166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dc6c52d9-2f65-4ffe-adc4-1ad6a5208e18 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:28.946625 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dc6c52d9-2f65-4ffe-adc4-1ad6a5208e18 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:29.068954 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6890582a-8966-485c-b032-c2d1a8f16380 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:29.069796 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6890582a-8966-485c-b032-c2d1a8f16380 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:29.076403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6890582a-8966-485c-b032-c2d1a8f16380 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:29.076900 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6890582a-8966-485c-b032-c2d1a8f16380 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:29.077339 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6890582a-8966-485c-b032-c2d1a8f16380 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:29.078076 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6890582a-8966-485c-b032-c2d1a8f16380 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:29.078540 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6890582a-8966-485c-b032-c2d1a8f16380 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:29.079004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6890582a-8966-485c-b032-c2d1a8f16380 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:29.108848 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dc6c52d9-2f65-4ffe-adc4-1ad6a5208e18 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:29.118145 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-dc6c52d9-2f65-4ffe-adc4-1ad6a5208e18 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.194471 Sep 16 08:07:29.118758 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 125/273] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:28 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:29.224427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6890582a-8966-485c-b032-c2d1a8f16380 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:29.232611 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6890582a-8966-485c-b032-c2d1a8f16380 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.167887 Sep 16 08:07:29.233116 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 149/274] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:29 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:29.823060 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-99266a31-b041-4f22-8c05-9f53f07fddbd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:29.823857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-99266a31-b041-4f22-8c05-9f53f07fddbd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:29.830854 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-99266a31-b041-4f22-8c05-9f53f07fddbd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:29.831332 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-99266a31-b041-4f22-8c05-9f53f07fddbd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:29.831789 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-99266a31-b041-4f22-8c05-9f53f07fddbd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:29.832464 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-99266a31-b041-4f22-8c05-9f53f07fddbd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:29.832910 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-99266a31-b041-4f22-8c05-9f53f07fddbd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:29.833327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-99266a31-b041-4f22-8c05-9f53f07fddbd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:29.949387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-93f5e5b6-e476-4ef1-a92d-d9260b455ed1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:29.950029 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-93f5e5b6-e476-4ef1-a92d-d9260b455ed1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:29.956378 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93f5e5b6-e476-4ef1-a92d-d9260b455ed1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:29.957393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93f5e5b6-e476-4ef1-a92d-d9260b455ed1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:29.957832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93f5e5b6-e476-4ef1-a92d-d9260b455ed1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:29.958565 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93f5e5b6-e476-4ef1-a92d-d9260b455ed1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:29.959047 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93f5e5b6-e476-4ef1-a92d-d9260b455ed1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:29.959472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93f5e5b6-e476-4ef1-a92d-d9260b455ed1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:29.979079 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-99266a31-b041-4f22-8c05-9f53f07fddbd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:29.987342 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-99266a31-b041-4f22-8c05-9f53f07fddbd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:29.988994 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-99266a31-b041-4f22-8c05-9f53f07fddbd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:29.990150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-99266a31-b041-4f22-8c05-9f53f07fddbd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.171362 Sep 16 08:07:29.990728 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 126/275] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:29 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:30.023215 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-93f5e5b6-e476-4ef1-a92d-d9260b455ed1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:30.043253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-93f5e5b6-e476-4ef1-a92d-d9260b455ed1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.087227 Sep 16 08:07:30.046817 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 150/276] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:29 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:30.141715 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3a83e0bb-ba62-432f-83f0-10d26a3824be tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:30.142275 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3a83e0bb-ba62-432f-83f0-10d26a3824be tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:30.148963 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3a83e0bb-ba62-432f-83f0-10d26a3824be tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:30.149454 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3a83e0bb-ba62-432f-83f0-10d26a3824be tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:30.150120 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3a83e0bb-ba62-432f-83f0-10d26a3824be tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:30.151023 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3a83e0bb-ba62-432f-83f0-10d26a3824be tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:30.151667 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3a83e0bb-ba62-432f-83f0-10d26a3824be tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:30.152310 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3a83e0bb-ba62-432f-83f0-10d26a3824be tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:30.265832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5f6a8bee-8fb9-4b40-a8df-6511f3fefdeb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:30.265832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5f6a8bee-8fb9-4b40-a8df-6511f3fefdeb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:30.265832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f6a8bee-8fb9-4b40-a8df-6511f3fefdeb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:30.265832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f6a8bee-8fb9-4b40-a8df-6511f3fefdeb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:30.266487 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f6a8bee-8fb9-4b40-a8df-6511f3fefdeb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:30.267737 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f6a8bee-8fb9-4b40-a8df-6511f3fefdeb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:30.268818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f6a8bee-8fb9-4b40-a8df-6511f3fefdeb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:30.270416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f6a8bee-8fb9-4b40-a8df-6511f3fefdeb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:30.403361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3a83e0bb-ba62-432f-83f0-10d26a3824be tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:30.407185 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3a83e0bb-ba62-432f-83f0-10d26a3824be tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.269505 Sep 16 08:07:30.408604 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 127/277] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:30 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 271 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:30.507524 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5f6a8bee-8fb9-4b40-a8df-6511f3fefdeb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:30.517870 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5f6a8bee-8fb9-4b40-a8df-6511f3fefdeb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.266106 Sep 16 08:07:30.518663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 151/278] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:30 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 268 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:31.015505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5fb1f366-4727-47ad-9e1b-ba21e19b75be tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:31.016271 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5fb1f366-4727-47ad-9e1b-ba21e19b75be tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:31.024170 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5fb1f366-4727-47ad-9e1b-ba21e19b75be tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:31.024775 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5fb1f366-4727-47ad-9e1b-ba21e19b75be tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:31.025577 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5fb1f366-4727-47ad-9e1b-ba21e19b75be tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:31.026507 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5fb1f366-4727-47ad-9e1b-ba21e19b75be tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:31.027280 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5fb1f366-4727-47ad-9e1b-ba21e19b75be tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:31.027948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5fb1f366-4727-47ad-9e1b-ba21e19b75be tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:31.074183 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7da05168-fa39-4d4d-839c-c4303fdb97b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:31.075387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7da05168-fa39-4d4d-839c-c4303fdb97b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:31.082738 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7da05168-fa39-4d4d-839c-c4303fdb97b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:31.083237 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7da05168-fa39-4d4d-839c-c4303fdb97b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:31.083675 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7da05168-fa39-4d4d-839c-c4303fdb97b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:31.084378 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7da05168-fa39-4d4d-839c-c4303fdb97b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:31.084834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7da05168-fa39-4d4d-839c-c4303fdb97b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:31.085262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7da05168-fa39-4d4d-839c-c4303fdb97b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:31.160776 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7da05168-fa39-4d4d-839c-c4303fdb97b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:31.169789 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7da05168-fa39-4d4d-839c-c4303fdb97b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.102612 Sep 16 08:07:31.170442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 152/279] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:31 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:31.184808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5fb1f366-4727-47ad-9e1b-ba21e19b75be tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:31.198412 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5fb1f366-4727-47ad-9e1b-ba21e19b75be tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:31.200908 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5fb1f366-4727-47ad-9e1b-ba21e19b75be tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:31.201529 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5fb1f366-4727-47ad-9e1b-ba21e19b75be tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.189797 Sep 16 08:07:31.201933 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 128/280] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:31 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:31.440847 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3d066281-e83a-417d-8acf-dc1b74d11e10 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:31.440847 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3d066281-e83a-417d-8acf-dc1b74d11e10 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:31.442977 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3d066281-e83a-417d-8acf-dc1b74d11e10 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:31.443479 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3d066281-e83a-417d-8acf-dc1b74d11e10 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:31.443924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3d066281-e83a-417d-8acf-dc1b74d11e10 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:31.444637 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3d066281-e83a-417d-8acf-dc1b74d11e10 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:31.445107 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3d066281-e83a-417d-8acf-dc1b74d11e10 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:31.445869 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3d066281-e83a-417d-8acf-dc1b74d11e10 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:31.544847 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-09938fe9-b82f-4439-898c-f7ec89adcf82 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:31.545881 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-09938fe9-b82f-4439-898c-f7ec89adcf82 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:31.554542 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-09938fe9-b82f-4439-898c-f7ec89adcf82 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:31.556283 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-09938fe9-b82f-4439-898c-f7ec89adcf82 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:31.557128 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-09938fe9-b82f-4439-898c-f7ec89adcf82 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:31.558265 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-09938fe9-b82f-4439-898c-f7ec89adcf82 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:31.559116 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-09938fe9-b82f-4439-898c-f7ec89adcf82 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:31.559853 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-09938fe9-b82f-4439-898c-f7ec89adcf82 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:31.662342 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3d066281-e83a-417d-8acf-dc1b74d11e10 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:31.670963 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3d066281-e83a-417d-8acf-dc1b74d11e10 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.244019 Sep 16 08:07:31.671552 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 153/281] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:31 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:31.753467 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-09938fe9-b82f-4439-898c-f7ec89adcf82 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:31.762915 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-09938fe9-b82f-4439-898c-f7ec89adcf82 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.223513 Sep 16 08:07:31.763772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 129/282] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:31 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:32.197276 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c271fc53-20fe-4b8d-b982-daea71647a78 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:32.197879 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c271fc53-20fe-4b8d-b982-daea71647a78 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:32.204609 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c271fc53-20fe-4b8d-b982-daea71647a78 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:32.205093 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c271fc53-20fe-4b8d-b982-daea71647a78 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:32.205528 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c271fc53-20fe-4b8d-b982-daea71647a78 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:32.206419 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c271fc53-20fe-4b8d-b982-daea71647a78 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:32.207545 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c271fc53-20fe-4b8d-b982-daea71647a78 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:32.208142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c271fc53-20fe-4b8d-b982-daea71647a78 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:32.227635 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a060de21-d0c3-4d00-8aa2-51068a7df03f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:32.228219 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a060de21-d0c3-4d00-8aa2-51068a7df03f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:32.230349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:32.231690 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=18 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:32.237003 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a060de21-d0c3-4d00-8aa2-51068a7df03f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:32.239655 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a060de21-d0c3-4d00-8aa2-51068a7df03f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:32.240266 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a060de21-d0c3-4d00-8aa2-51068a7df03f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:32.241178 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a060de21-d0c3-4d00-8aa2-51068a7df03f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:32.241663 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a060de21-d0c3-4d00-8aa2-51068a7df03f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:32.242087 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a060de21-d0c3-4d00-8aa2-51068a7df03f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:32.312133 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c271fc53-20fe-4b8d-b982-daea71647a78 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:32.314632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:32.324078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c271fc53-20fe-4b8d-b982-daea71647a78 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.129140 Sep 16 08:07:32.324078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 154/283] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:32 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 131 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:32.541590 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a060de21-d0c3-4d00-8aa2-51068a7df03f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:32.559048 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a060de21-d0c3-4d00-8aa2-51068a7df03f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:32.559311 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a060de21-d0c3-4d00-8aa2-51068a7df03f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:32.564160 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a060de21-d0c3-4d00-8aa2-51068a7df03f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.340616 Sep 16 08:07:32.566743 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 130/284] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:32 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 343 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:32.699376 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-32dadae0-bc4a-4dbc-8163-b4d0ba018766 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:32.700000 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-32dadae0-bc4a-4dbc-8163-b4d0ba018766 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:32.708106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32dadae0-bc4a-4dbc-8163-b4d0ba018766 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:32.708847 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32dadae0-bc4a-4dbc-8163-b4d0ba018766 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:32.709456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32dadae0-bc4a-4dbc-8163-b4d0ba018766 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:32.710489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32dadae0-bc4a-4dbc-8163-b4d0ba018766 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:32.711136 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32dadae0-bc4a-4dbc-8163-b4d0ba018766 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:32.711756 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32dadae0-bc4a-4dbc-8163-b4d0ba018766 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:32.788865 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b19af2ef-bcae-4b46-9b16-220830b36c3c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:32.789497 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b19af2ef-bcae-4b46-9b16-220830b36c3c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:32.801871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b19af2ef-bcae-4b46-9b16-220830b36c3c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:32.802388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b19af2ef-bcae-4b46-9b16-220830b36c3c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:32.804479 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b19af2ef-bcae-4b46-9b16-220830b36c3c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:32.807366 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b19af2ef-bcae-4b46-9b16-220830b36c3c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:32.810197 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b19af2ef-bcae-4b46-9b16-220830b36c3c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:32.810711 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b19af2ef-bcae-4b46-9b16-220830b36c3c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:32.923795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-32dadae0-bc4a-4dbc-8163-b4d0ba018766 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:32.933848 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-32dadae0-bc4a-4dbc-8163-b4d0ba018766 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.238928 Sep 16 08:07:32.951247 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 155/285] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:32 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:33.058887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b19af2ef-bcae-4b46-9b16-220830b36c3c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:33.068622 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b19af2ef-bcae-4b46-9b16-220830b36c3c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.284434 Sep 16 08:07:33.069232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 131/286] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:32 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:33.346244 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-23e3faeb-2fb8-4002-b900-c7681e9c3fbe tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:33.347597 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-23e3faeb-2fb8-4002-b900-c7681e9c3fbe tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:33.354549 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-23e3faeb-2fb8-4002-b900-c7681e9c3fbe tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:33.355327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-23e3faeb-2fb8-4002-b900-c7681e9c3fbe tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:33.356018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-23e3faeb-2fb8-4002-b900-c7681e9c3fbe tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:33.356964 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-23e3faeb-2fb8-4002-b900-c7681e9c3fbe tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:33.357642 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-23e3faeb-2fb8-4002-b900-c7681e9c3fbe tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:33.358281 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-23e3faeb-2fb8-4002-b900-c7681e9c3fbe tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:33.423921 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-23e3faeb-2fb8-4002-b900-c7681e9c3fbe tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:33.431703 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-23e3faeb-2fb8-4002-b900-c7681e9c3fbe tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.089433 Sep 16 08:07:33.432275 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 156/287] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:33 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:33.593608 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0912b041-7b28-4011-b5cd-a91764558360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:33.595377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0912b041-7b28-4011-b5cd-a91764558360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:33.604730 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0912b041-7b28-4011-b5cd-a91764558360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:33.604730 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0912b041-7b28-4011-b5cd-a91764558360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:33.604730 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0912b041-7b28-4011-b5cd-a91764558360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:33.604730 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0912b041-7b28-4011-b5cd-a91764558360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:33.605052 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0912b041-7b28-4011-b5cd-a91764558360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:33.605052 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0912b041-7b28-4011-b5cd-a91764558360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:33.759920 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0912b041-7b28-4011-b5cd-a91764558360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:33.767865 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0912b041-7b28-4011-b5cd-a91764558360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:33.769392 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0912b041-7b28-4011-b5cd-a91764558360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:33.770537 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0912b041-7b28-4011-b5cd-a91764558360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.182217 Sep 16 08:07:33.771135 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 132/288] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:33 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:33.960841 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7c8a3e31-2f39-4072-a3b8-86a0e30a8c6e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:33.961559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7c8a3e31-2f39-4072-a3b8-86a0e30a8c6e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:33.972882 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7c8a3e31-2f39-4072-a3b8-86a0e30a8c6e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:33.976891 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7c8a3e31-2f39-4072-a3b8-86a0e30a8c6e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:33.976891 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7c8a3e31-2f39-4072-a3b8-86a0e30a8c6e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:33.976891 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7c8a3e31-2f39-4072-a3b8-86a0e30a8c6e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:33.976891 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7c8a3e31-2f39-4072-a3b8-86a0e30a8c6e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:33.977550 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7c8a3e31-2f39-4072-a3b8-86a0e30a8c6e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:34.093124 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4f72fe99-cfe4-4d47-a68b-9058ddc59fb1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:34.093874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4f72fe99-cfe4-4d47-a68b-9058ddc59fb1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:34.106007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4f72fe99-cfe4-4d47-a68b-9058ddc59fb1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:34.106699 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4f72fe99-cfe4-4d47-a68b-9058ddc59fb1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:34.108926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4f72fe99-cfe4-4d47-a68b-9058ddc59fb1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:34.110267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4f72fe99-cfe4-4d47-a68b-9058ddc59fb1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:34.111338 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4f72fe99-cfe4-4d47-a68b-9058ddc59fb1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:34.116896 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4f72fe99-cfe4-4d47-a68b-9058ddc59fb1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:34.151567 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7c8a3e31-2f39-4072-a3b8-86a0e30a8c6e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:34.159571 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7c8a3e31-2f39-4072-a3b8-86a0e30a8c6e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.202668 Sep 16 08:07:34.160551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 157/289] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:33 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 204 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:34.274250 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-4f72fe99-cfe4-4d47-a68b-9058ddc59fb1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:34.276729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=100 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:34.283140 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4f72fe99-cfe4-4d47-a68b-9058ddc59fb1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.195045 Sep 16 08:07:34.283719 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 133/290] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:34 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:34.456645 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4bfbdc53-1862-4674-a250-2a86bdb0d825 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:34.457859 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4bfbdc53-1862-4674-a250-2a86bdb0d825 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:34.464454 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4bfbdc53-1862-4674-a250-2a86bdb0d825 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:34.464935 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4bfbdc53-1862-4674-a250-2a86bdb0d825 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:34.465374 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4bfbdc53-1862-4674-a250-2a86bdb0d825 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:34.466064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4bfbdc53-1862-4674-a250-2a86bdb0d825 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:34.466539 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4bfbdc53-1862-4674-a250-2a86bdb0d825 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:34.466990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4bfbdc53-1862-4674-a250-2a86bdb0d825 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:34.533259 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4bfbdc53-1862-4674-a250-2a86bdb0d825 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:34.541964 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4bfbdc53-1862-4674-a250-2a86bdb0d825 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.089157 Sep 16 08:07:34.545128 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 158/291] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:34 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:34.796195 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-899c4571-3fb3-42fe-b078-0c9c26b14e0d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:34.797071 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-899c4571-3fb3-42fe-b078-0c9c26b14e0d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:34.804379 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-899c4571-3fb3-42fe-b078-0c9c26b14e0d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:34.804858 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-899c4571-3fb3-42fe-b078-0c9c26b14e0d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:34.805287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-899c4571-3fb3-42fe-b078-0c9c26b14e0d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:34.805969 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-899c4571-3fb3-42fe-b078-0c9c26b14e0d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:34.806421 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-899c4571-3fb3-42fe-b078-0c9c26b14e0d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:34.806877 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-899c4571-3fb3-42fe-b078-0c9c26b14e0d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:34.953185 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-899c4571-3fb3-42fe-b078-0c9c26b14e0d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:34.961820 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-899c4571-3fb3-42fe-b078-0c9c26b14e0d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:34.965011 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-899c4571-3fb3-42fe-b078-0c9c26b14e0d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:34.965011 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-899c4571-3fb3-42fe-b078-0c9c26b14e0d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.172381 Sep 16 08:07:34.982875 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 134/292] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:34 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:35.184158 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-065d8c27-8a4b-4e14-bbcc-5ccdbf86e2db tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:35.184775 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-065d8c27-8a4b-4e14-bbcc-5ccdbf86e2db tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:35.190718 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-065d8c27-8a4b-4e14-bbcc-5ccdbf86e2db tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:35.191337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-065d8c27-8a4b-4e14-bbcc-5ccdbf86e2db tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:35.191784 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-065d8c27-8a4b-4e14-bbcc-5ccdbf86e2db tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:35.192481 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-065d8c27-8a4b-4e14-bbcc-5ccdbf86e2db tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:35.192941 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-065d8c27-8a4b-4e14-bbcc-5ccdbf86e2db tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:35.193373 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-065d8c27-8a4b-4e14-bbcc-5ccdbf86e2db tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:35.306247 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7f437774-4f2a-469f-abd6-4571155fd94e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:35.307056 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7f437774-4f2a-469f-abd6-4571155fd94e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:35.313842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7f437774-4f2a-469f-abd6-4571155fd94e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:35.314568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7f437774-4f2a-469f-abd6-4571155fd94e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:35.315330 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7f437774-4f2a-469f-abd6-4571155fd94e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:35.316247 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7f437774-4f2a-469f-abd6-4571155fd94e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:35.316852 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7f437774-4f2a-469f-abd6-4571155fd94e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:35.317488 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7f437774-4f2a-469f-abd6-4571155fd94e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:35.333080 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-065d8c27-8a4b-4e14-bbcc-5ccdbf86e2db tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:35.345636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-065d8c27-8a4b-4e14-bbcc-5ccdbf86e2db tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.165268 Sep 16 08:07:35.350771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 159/293] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:35 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:35.491059 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7f437774-4f2a-469f-abd6-4571155fd94e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:35.501309 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7f437774-4f2a-469f-abd6-4571155fd94e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.199613 Sep 16 08:07:35.509760 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 135/294] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:35 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:35.565679 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8931319c-033a-48e6-a874-1b7229152715 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:35.567642 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8931319c-033a-48e6-a874-1b7229152715 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:35.575318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8931319c-033a-48e6-a874-1b7229152715 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:35.576164 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8931319c-033a-48e6-a874-1b7229152715 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:35.576830 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8931319c-033a-48e6-a874-1b7229152715 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:35.577780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8931319c-033a-48e6-a874-1b7229152715 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:35.578721 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8931319c-033a-48e6-a874-1b7229152715 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:35.579396 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8931319c-033a-48e6-a874-1b7229152715 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:35.644272 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8931319c-033a-48e6-a874-1b7229152715 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:35.652977 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8931319c-033a-48e6-a874-1b7229152715 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.091162 Sep 16 08:07:35.653794 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 160/295] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:35 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:35.990458 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fde22d5e-5c48-4cdd-b9fc-38616ebde37e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:35.991101 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-fde22d5e-5c48-4cdd-b9fc-38616ebde37e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:35.997599 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fde22d5e-5c48-4cdd-b9fc-38616ebde37e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:35.998076 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fde22d5e-5c48-4cdd-b9fc-38616ebde37e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:35.998643 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fde22d5e-5c48-4cdd-b9fc-38616ebde37e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:35.999353 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fde22d5e-5c48-4cdd-b9fc-38616ebde37e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:35.999801 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fde22d5e-5c48-4cdd-b9fc-38616ebde37e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:36.000222 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fde22d5e-5c48-4cdd-b9fc-38616ebde37e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:36.174170 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fde22d5e-5c48-4cdd-b9fc-38616ebde37e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:36.184010 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fde22d5e-5c48-4cdd-b9fc-38616ebde37e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:36.185834 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fde22d5e-5c48-4cdd-b9fc-38616ebde37e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:36.187499 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-fde22d5e-5c48-4cdd-b9fc-38616ebde37e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.201013 Sep 16 08:07:36.188549 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 136/296] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:35 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:36.369162 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3c654906-56b9-4692-afe3-ca1642629568 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:36.369773 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3c654906-56b9-4692-afe3-ca1642629568 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:36.371642 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:36.376240 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c654906-56b9-4692-afe3-ca1642629568 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:36.376722 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c654906-56b9-4692-afe3-ca1642629568 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:36.377164 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c654906-56b9-4692-afe3-ca1642629568 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:36.377852 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c654906-56b9-4692-afe3-ca1642629568 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:36.378312 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c654906-56b9-4692-afe3-ca1642629568 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:36.379356 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c654906-56b9-4692-afe3-ca1642629568 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:36.514587 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3c654906-56b9-4692-afe3-ca1642629568 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:36.523354 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3c654906-56b9-4692-afe3-ca1642629568 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.157982 Sep 16 08:07:36.524373 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 161/297] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:36 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:36.525961 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9b694b62-8008-4546-b337-76f1104a39e6 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:36.527479 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9b694b62-8008-4546-b337-76f1104a39e6 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:36.534541 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9b694b62-8008-4546-b337-76f1104a39e6 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:36.535355 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9b694b62-8008-4546-b337-76f1104a39e6 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:36.536130 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9b694b62-8008-4546-b337-76f1104a39e6 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:36.536924 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9b694b62-8008-4546-b337-76f1104a39e6 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:36.537573 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9b694b62-8008-4546-b337-76f1104a39e6 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:36.538098 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9b694b62-8008-4546-b337-76f1104a39e6 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:36.669709 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9b694b62-8008-4546-b337-76f1104a39e6 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:36.676464 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8ea48a07-48a4-4955-b9f3-78d8ee766213 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:36.677075 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8ea48a07-48a4-4955-b9f3-78d8ee766213 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:36.678037 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9b694b62-8008-4546-b337-76f1104a39e6 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.155993 Sep 16 08:07:36.678710 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 137/298] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:36 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:36.683991 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ea48a07-48a4-4955-b9f3-78d8ee766213 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:36.684286 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ea48a07-48a4-4955-b9f3-78d8ee766213 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:36.684561 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ea48a07-48a4-4955-b9f3-78d8ee766213 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:36.685257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ea48a07-48a4-4955-b9f3-78d8ee766213 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:36.685716 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ea48a07-48a4-4955-b9f3-78d8ee766213 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:36.686144 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ea48a07-48a4-4955-b9f3-78d8ee766213 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:36.758940 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8ea48a07-48a4-4955-b9f3-78d8ee766213 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:36.767036 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8ea48a07-48a4-4955-b9f3-78d8ee766213 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.094539 Sep 16 08:07:36.767863 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 162/299] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:36 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:37.213423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e00d14a1-bed0-4067-b61b-18acb8d58532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:37.214335 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e00d14a1-bed0-4067-b61b-18acb8d58532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:37.221121 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e00d14a1-bed0-4067-b61b-18acb8d58532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:37.221727 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e00d14a1-bed0-4067-b61b-18acb8d58532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:37.222817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e00d14a1-bed0-4067-b61b-18acb8d58532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:37.223615 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e00d14a1-bed0-4067-b61b-18acb8d58532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:37.224170 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e00d14a1-bed0-4067-b61b-18acb8d58532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:37.224838 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e00d14a1-bed0-4067-b61b-18acb8d58532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:37.377366 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e00d14a1-bed0-4067-b61b-18acb8d58532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:37.386867 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e00d14a1-bed0-4067-b61b-18acb8d58532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:37.388364 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e00d14a1-bed0-4067-b61b-18acb8d58532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:37.389792 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e00d14a1-bed0-4067-b61b-18acb8d58532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.180449 Sep 16 08:07:37.390369 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 138/300] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:37 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:37.547532 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8dc90414-dfce-4baf-a996-821c4d62b8e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:37.548138 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8dc90414-dfce-4baf-a996-821c4d62b8e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:37.554106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8dc90414-dfce-4baf-a996-821c4d62b8e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:37.554579 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8dc90414-dfce-4baf-a996-821c4d62b8e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:37.555046 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8dc90414-dfce-4baf-a996-821c4d62b8e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:37.555726 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8dc90414-dfce-4baf-a996-821c4d62b8e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:37.556180 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8dc90414-dfce-4baf-a996-821c4d62b8e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:37.556597 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8dc90414-dfce-4baf-a996-821c4d62b8e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:37.705099 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-72ab0943-20df-4c02-949c-c4a7e478bd7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:37.705796 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-72ab0943-20df-4c02-949c-c4a7e478bd7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:37.712377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72ab0943-20df-4c02-949c-c4a7e478bd7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:37.712862 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72ab0943-20df-4c02-949c-c4a7e478bd7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:37.713304 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72ab0943-20df-4c02-949c-c4a7e478bd7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:37.713998 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72ab0943-20df-4c02-949c-c4a7e478bd7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:37.714448 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72ab0943-20df-4c02-949c-c4a7e478bd7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:37.715027 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72ab0943-20df-4c02-949c-c4a7e478bd7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:37.723747 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8dc90414-dfce-4baf-a996-821c4d62b8e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:37.731688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8dc90414-dfce-4baf-a996-821c4d62b8e3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.188041 Sep 16 08:07:37.732341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 163/301] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:37 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:37.792517 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c6183050-a7dd-48ce-85f0-cfafa0b0ad26 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:37.815203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c6183050-a7dd-48ce-85f0-cfafa0b0ad26 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:37.815203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c6183050-a7dd-48ce-85f0-cfafa0b0ad26 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:37.815203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c6183050-a7dd-48ce-85f0-cfafa0b0ad26 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:37.815203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c6183050-a7dd-48ce-85f0-cfafa0b0ad26 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:37.816819 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c6183050-a7dd-48ce-85f0-cfafa0b0ad26 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:37.816819 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c6183050-a7dd-48ce-85f0-cfafa0b0ad26 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:37.816819 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c6183050-a7dd-48ce-85f0-cfafa0b0ad26 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:37.871039 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-72ab0943-20df-4c02-949c-c4a7e478bd7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:37.882322 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-72ab0943-20df-4c02-949c-c4a7e478bd7b tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.180976 Sep 16 08:07:37.884456 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 139/302] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:37 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:37.884748 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c6183050-a7dd-48ce-85f0-cfafa0b0ad26 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:37.894968 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c6183050-a7dd-48ce-85f0-cfafa0b0ad26 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.102983 Sep 16 08:07:37.894968 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 164/303] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:37 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:38.416811 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-952fc13b-1889-4df7-91e9-de62ff9afaae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:38.416811 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-952fc13b-1889-4df7-91e9-de62ff9afaae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:38.422697 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-952fc13b-1889-4df7-91e9-de62ff9afaae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:38.423299 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-952fc13b-1889-4df7-91e9-de62ff9afaae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:38.423834 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-952fc13b-1889-4df7-91e9-de62ff9afaae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:38.424652 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-952fc13b-1889-4df7-91e9-de62ff9afaae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:38.425709 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-952fc13b-1889-4df7-91e9-de62ff9afaae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:38.426237 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-952fc13b-1889-4df7-91e9-de62ff9afaae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:38.642637 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-952fc13b-1889-4df7-91e9-de62ff9afaae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:38.651498 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-952fc13b-1889-4df7-91e9-de62ff9afaae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:38.652943 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-952fc13b-1889-4df7-91e9-de62ff9afaae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:38.654054 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-952fc13b-1889-4df7-91e9-de62ff9afaae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1408 microversion: 2.20 time: 0.243090 Sep 16 08:07:38.654606 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 140/304] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:38 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1408 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:38.761649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-64716e5c-e181-45a6-9470-910a11c6e87a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:38.762389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-64716e5c-e181-45a6-9470-910a11c6e87a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:38.769008 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-64716e5c-e181-45a6-9470-910a11c6e87a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:38.769486 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-64716e5c-e181-45a6-9470-910a11c6e87a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:38.769919 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-64716e5c-e181-45a6-9470-910a11c6e87a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:38.770598 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-64716e5c-e181-45a6-9470-910a11c6e87a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:38.771072 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-64716e5c-e181-45a6-9470-910a11c6e87a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:38.771493 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-64716e5c-e181-45a6-9470-910a11c6e87a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:38.897841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-482e429c-cda5-4101-9d30-d83b7836f443 req-05f54836-b7b9-464a-9787-edd6b69cd661 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998c37d2-18ab-459f-a9d6-bf19c51fb695", "tag": "800c16c0-6c80-47ad-8a9f-a60246ce9a01"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:38.903215 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-64716e5c-e181-45a6-9470-910a11c6e87a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:38.909072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-482e429c-cda5-4101-9d30-d83b7836f443 req-05f54836-b7b9-464a-9787-edd6b69cd661 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:38.910601 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-482e429c-cda5-4101-9d30-d83b7836f443 req-05f54836-b7b9-464a-9787-edd6b69cd661 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:38.911236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-482e429c-cda5-4101-9d30-d83b7836f443 req-05f54836-b7b9-464a-9787-edd6b69cd661 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:38.915431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-64716e5c-e181-45a6-9470-910a11c6e87a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.157310 Sep 16 08:07:38.926031 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 165/305] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:38 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:38.931219 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9b1f7b9f-ad70-4b4f-94de-a261214cab5b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:38.931832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-9b1f7b9f-ad70-4b4f-94de-a261214cab5b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:38.931961 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-482e429c-cda5-4101-9d30-d83b7836f443 req-05f54836-b7b9-464a-9787-edd6b69cd661 service nova] Creating event network-changed:800c16c0-6c80-47ad-8a9f-a60246ce9a01 for instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 on hv-cinder-74014 Sep 16 08:07:38.939645 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-482e429c-cda5-4101-9d30-d83b7836f443 req-05f54836-b7b9-464a-9787-edd6b69cd661 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.045533 Sep 16 08:07:38.944172 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 141/306] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:07:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:07:38.945289 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9b0f4369-5189-4d73-bc07-bb17d99e2a2d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:38.945929 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9b1f7b9f-ad70-4b4f-94de-a261214cab5b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:38.946032 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9b0f4369-5189-4d73-bc07-bb17d99e2a2d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:38.946504 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9b1f7b9f-ad70-4b4f-94de-a261214cab5b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:38.947053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9b1f7b9f-ad70-4b4f-94de-a261214cab5b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:38.947856 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9b1f7b9f-ad70-4b4f-94de-a261214cab5b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:38.948527 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9b1f7b9f-ad70-4b4f-94de-a261214cab5b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:38.949028 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9b1f7b9f-ad70-4b4f-94de-a261214cab5b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:38.952254 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9b0f4369-5189-4d73-bc07-bb17d99e2a2d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:38.952731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9b0f4369-5189-4d73-bc07-bb17d99e2a2d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:38.953163 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9b0f4369-5189-4d73-bc07-bb17d99e2a2d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:38.954034 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9b0f4369-5189-4d73-bc07-bb17d99e2a2d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:38.954698 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9b0f4369-5189-4d73-bc07-bb17d99e2a2d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:38.955130 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9b0f4369-5189-4d73-bc07-bb17d99e2a2d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:39.013779 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-9b1f7b9f-ad70-4b4f-94de-a261214cab5b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:39.022559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9b1f7b9f-ad70-4b4f-94de-a261214cab5b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.095200 Sep 16 08:07:39.023660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 166/307] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:38 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:39.095652 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9b0f4369-5189-4d73-bc07-bb17d99e2a2d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:39.103825 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9b0f4369-5189-4d73-bc07-bb17d99e2a2d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.162403 Sep 16 08:07:39.110698 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 142/308] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:38 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:39.679512 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-560a39c1-661a-4662-9d87-13089f4d3562 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:39.680120 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-560a39c1-661a-4662-9d87-13089f4d3562 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:39.686062 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-560a39c1-661a-4662-9d87-13089f4d3562 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:39.686544 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-560a39c1-661a-4662-9d87-13089f4d3562 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:39.687016 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-560a39c1-661a-4662-9d87-13089f4d3562 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:39.687712 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-560a39c1-661a-4662-9d87-13089f4d3562 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:39.688165 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-560a39c1-661a-4662-9d87-13089f4d3562 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:39.688588 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-560a39c1-661a-4662-9d87-13089f4d3562 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:39.822983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-560a39c1-661a-4662-9d87-13089f4d3562 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:39.831862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-560a39c1-661a-4662-9d87-13089f4d3562 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:39.833381 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-560a39c1-661a-4662-9d87-13089f4d3562 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:39.836708 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-560a39c1-661a-4662-9d87-13089f4d3562 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1600 microversion: 2.20 time: 0.159678 Sep 16 08:07:39.836708 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 167/309] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:07:39 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1600 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:07:39.860167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4f632429-df8d-4795-86b7-ead4385a729b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:39.860765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4f632429-df8d-4795-86b7-ead4385a729b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:39.867874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4f632429-df8d-4795-86b7-ead4385a729b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:39.868363 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4f632429-df8d-4795-86b7-ead4385a729b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:39.868804 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4f632429-df8d-4795-86b7-ead4385a729b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:39.869505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4f632429-df8d-4795-86b7-ead4385a729b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:39.869959 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4f632429-df8d-4795-86b7-ead4385a729b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:39.870383 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4f632429-df8d-4795-86b7-ead4385a729b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:39.940109 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-67f9522a-9273-4508-bcbe-24566b0b6367 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:39.940810 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-67f9522a-9273-4508-bcbe-24566b0b6367 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:39.952142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67f9522a-9273-4508-bcbe-24566b0b6367 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:39.958462 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67f9522a-9273-4508-bcbe-24566b0b6367 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:39.958462 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67f9522a-9273-4508-bcbe-24566b0b6367 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:39.958462 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67f9522a-9273-4508-bcbe-24566b0b6367 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:39.958462 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67f9522a-9273-4508-bcbe-24566b0b6367 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:39.958899 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67f9522a-9273-4508-bcbe-24566b0b6367 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:39.967888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4f632429-df8d-4795-86b7-ead4385a729b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-interface" status: 200 len: 284 microversion: 2.20 time: 0.111720 Sep 16 08:07:39.969571 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 143/310] 10.222.0.59 () {60 vars in 1316 bytes} [Fri Sep 16 08:07:39 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-interface => generated 284 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 08:07:40.050338 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0ac2e2a8-b245-4c85-a1d6-0b37a0cd77c5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:40.050338 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0ac2e2a8-b245-4c85-a1d6-0b37a0cd77c5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:40.055009 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0ac2e2a8-b245-4c85-a1d6-0b37a0cd77c5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:40.055892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0ac2e2a8-b245-4c85-a1d6-0b37a0cd77c5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:40.056499 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0ac2e2a8-b245-4c85-a1d6-0b37a0cd77c5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:40.057360 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0ac2e2a8-b245-4c85-a1d6-0b37a0cd77c5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:40.057968 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0ac2e2a8-b245-4c85-a1d6-0b37a0cd77c5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:40.058563 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0ac2e2a8-b245-4c85-a1d6-0b37a0cd77c5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:40.150205 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0ac2e2a8-b245-4c85-a1d6-0b37a0cd77c5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:40.154980 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0ac2e2a8-b245-4c85-a1d6-0b37a0cd77c5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.112916 Sep 16 08:07:40.155737 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 144/311] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:40 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 114 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:40.160988 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9f7406f9-850c-4467-a692-76827f9460fc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:40.162012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9f7406f9-850c-4467-a692-76827f9460fc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:40.169125 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9f7406f9-850c-4467-a692-76827f9460fc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:40.170062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9f7406f9-850c-4467-a692-76827f9460fc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:40.170780 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9f7406f9-850c-4467-a692-76827f9460fc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:40.171483 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9f7406f9-850c-4467-a692-76827f9460fc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:40.172046 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9f7406f9-850c-4467-a692-76827f9460fc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:40.172503 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9f7406f9-850c-4467-a692-76827f9460fc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:40.238734 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-67f9522a-9273-4508-bcbe-24566b0b6367 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:40.246884 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-67f9522a-9273-4508-bcbe-24566b0b6367 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.311372 Sep 16 08:07:40.247709 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 168/312] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:39 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:40.318820 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9f7406f9-850c-4467-a692-76827f9460fc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:40.328947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9f7406f9-850c-4467-a692-76827f9460fc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.171715 Sep 16 08:07:40.329606 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 145/313] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:40 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:41.178219 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c5e9236b-dc91-4681-a25b-aa13619688a3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:41.179025 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c5e9236b-dc91-4681-a25b-aa13619688a3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:41.185951 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c5e9236b-dc91-4681-a25b-aa13619688a3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:41.186968 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c5e9236b-dc91-4681-a25b-aa13619688a3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:41.187860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c5e9236b-dc91-4681-a25b-aa13619688a3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:41.189103 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c5e9236b-dc91-4681-a25b-aa13619688a3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:41.190404 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c5e9236b-dc91-4681-a25b-aa13619688a3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:41.191072 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c5e9236b-dc91-4681-a25b-aa13619688a3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:41.272463 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-dd18274f-7412-471a-9ada-69c2ae2c0b49 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:41.273087 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-dd18274f-7412-471a-9ada-69c2ae2c0b49 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:41.290584 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dd18274f-7412-471a-9ada-69c2ae2c0b49 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:41.306586 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dd18274f-7412-471a-9ada-69c2ae2c0b49 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:41.307184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dd18274f-7412-471a-9ada-69c2ae2c0b49 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.016s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:41.307958 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dd18274f-7412-471a-9ada-69c2ae2c0b49 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:41.310752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dd18274f-7412-471a-9ada-69c2ae2c0b49 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:41.311225 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dd18274f-7412-471a-9ada-69c2ae2c0b49 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:41.457684 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c5e9236b-dc91-4681-a25b-aa13619688a3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:41.475430 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c5e9236b-dc91-4681-a25b-aa13619688a3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1292 microversion: 2.1 time: 0.301405 Sep 16 08:07:41.511992 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 169/314] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:41 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1292 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:41.517265 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-da223a65-1980-4a4d-9689-24d70b22b630 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:41.519325 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-da223a65-1980-4a4d-9689-24d70b22b630 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:41.526464 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da223a65-1980-4a4d-9689-24d70b22b630 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:41.527380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da223a65-1980-4a4d-9689-24d70b22b630 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:41.528108 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da223a65-1980-4a4d-9689-24d70b22b630 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:41.529047 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da223a65-1980-4a4d-9689-24d70b22b630 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:41.529745 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da223a65-1980-4a4d-9689-24d70b22b630 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:41.530402 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da223a65-1980-4a4d-9689-24d70b22b630 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:41.830197 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-da223a65-1980-4a4d-9689-24d70b22b630 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:41.846267 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-da223a65-1980-4a4d-9689-24d70b22b630 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.332034 Sep 16 08:07:41.846267 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 170/315] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:41 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:41.874268 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-14a966d9-e076-454b-94c9-3856a02afcc7 req-6a2e68e9-1658-48f8-b242-f679f98afdf3 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c", "tag": "0104ad2b-b1c9-455f-a512-cdc1dd34408e"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:41.887498 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-14a966d9-e076-454b-94c9-3856a02afcc7 req-6a2e68e9-1658-48f8-b242-f679f98afdf3 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:41.888331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-14a966d9-e076-454b-94c9-3856a02afcc7 req-6a2e68e9-1658-48f8-b242-f679f98afdf3 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:41.888776 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-14a966d9-e076-454b-94c9-3856a02afcc7 req-6a2e68e9-1658-48f8-b242-f679f98afdf3 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:41.903427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-14a966d9-e076-454b-94c9-3856a02afcc7 req-6a2e68e9-1658-48f8-b242-f679f98afdf3 service nova] Creating event network-changed:0104ad2b-b1c9-455f-a512-cdc1dd34408e for instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c on hv-cinder-74014 Sep 16 08:07:41.924158 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-14a966d9-e076-454b-94c9-3856a02afcc7 req-6a2e68e9-1658-48f8-b242-f679f98afdf3 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.044275 Sep 16 08:07:41.924158 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 171/316] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:07:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:07:42.048504 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dd18274f-7412-471a-9ada-69c2ae2c0b49 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:42.056497 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-dd18274f-7412-471a-9ada-69c2ae2c0b49 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.788464 Sep 16 08:07:42.057102 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 146/317] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:41 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 790 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:42.395256 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4a1f666c-c2e6-41a1-b22d-19b0c3ff144e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:42.403815 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4a1f666c-c2e6-41a1-b22d-19b0c3ff144e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:42.404307 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4a1f666c-c2e6-41a1-b22d-19b0c3ff144e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:42.404752 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4a1f666c-c2e6-41a1-b22d-19b0c3ff144e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:42.453743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:42.497156 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4a1f666c-c2e6-41a1-b22d-19b0c3ff144e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Going to try to stop instance {{(pid=121046) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 08:07:42.507082 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-cadc047d-da70-45ca-93ee-d1d793e7fd50 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:42.507695 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-cadc047d-da70-45ca-93ee-d1d793e7fd50 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:42.518506 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cadc047d-da70-45ca-93ee-d1d793e7fd50 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:42.521249 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cadc047d-da70-45ca-93ee-d1d793e7fd50 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:42.521913 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cadc047d-da70-45ca-93ee-d1d793e7fd50 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:42.523625 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cadc047d-da70-45ca-93ee-d1d793e7fd50 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:42.524513 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cadc047d-da70-45ca-93ee-d1d793e7fd50 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:42.526513 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cadc047d-da70-45ca-93ee-d1d793e7fd50 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:42.615762 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cadc047d-da70-45ca-93ee-d1d793e7fd50 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:42.629876 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-cadc047d-da70-45ca-93ee-d1d793e7fd50 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1300 microversion: 2.1 time: 0.127853 Sep 16 08:07:42.630468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 147/318] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:42 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1300 bytes in 129 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:42.697689 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4a1f666c-c2e6-41a1-b22d-19b0c3ff144e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "POST /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/action" status: 202 len: 0 microversion: 2.1 time: 0.313371 Sep 16 08:07:42.704273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 172/319] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:07:42 2022] POST /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/action => generated 0 bytes in 321 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:07:42.720139 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-dc763308-2835-42fd-a7bf-05378e7402aa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:42.724903 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-dc763308-2835-42fd-a7bf-05378e7402aa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:42.746473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dc763308-2835-42fd-a7bf-05378e7402aa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:42.749114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dc763308-2835-42fd-a7bf-05378e7402aa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:42.752912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dc763308-2835-42fd-a7bf-05378e7402aa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:42.752912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dc763308-2835-42fd-a7bf-05378e7402aa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:42.752912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dc763308-2835-42fd-a7bf-05378e7402aa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:42.755784 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dc763308-2835-42fd-a7bf-05378e7402aa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:42.869927 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7d2cdf8b-2366-4ed1-9274-29279359963f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:42.870644 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7d2cdf8b-2366-4ed1-9274-29279359963f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:42.886843 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d2cdf8b-2366-4ed1-9274-29279359963f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:42.887351 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d2cdf8b-2366-4ed1-9274-29279359963f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:42.891217 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d2cdf8b-2366-4ed1-9274-29279359963f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:42.892014 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d2cdf8b-2366-4ed1-9274-29279359963f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:42.894449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d2cdf8b-2366-4ed1-9274-29279359963f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:42.897177 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d2cdf8b-2366-4ed1-9274-29279359963f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:43.024911 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dc763308-2835-42fd-a7bf-05378e7402aa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:43.035430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-dc763308-2835-42fd-a7bf-05378e7402aa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.329995 Sep 16 08:07:43.048319 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 148/320] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:42 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 344 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:43.093418 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7d2cdf8b-2366-4ed1-9274-29279359963f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:43.099299 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-28af2003-18e6-4132-bc96-bf973bca84d0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:43.099981 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-28af2003-18e6-4132-bc96-bf973bca84d0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:43.101885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7d2cdf8b-2366-4ed1-9274-29279359963f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.238124 Sep 16 08:07:43.102469 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 173/321] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:42 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:43.107806 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28af2003-18e6-4132-bc96-bf973bca84d0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:43.108611 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28af2003-18e6-4132-bc96-bf973bca84d0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:43.109369 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28af2003-18e6-4132-bc96-bf973bca84d0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:43.110189 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28af2003-18e6-4132-bc96-bf973bca84d0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:43.110819 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28af2003-18e6-4132-bc96-bf973bca84d0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:43.111528 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28af2003-18e6-4132-bc96-bf973bca84d0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:43.517557 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-28af2003-18e6-4132-bc96-bf973bca84d0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:43.525802 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-28af2003-18e6-4132-bc96-bf973bca84d0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.448259 Sep 16 08:07:43.526384 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 149/322] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:43 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 450 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:43.653171 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7cc2b8c6-ac78-4a31-bae9-42b8e0c62991 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:43.653697 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7cc2b8c6-ac78-4a31-bae9-42b8e0c62991 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:43.661340 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7cc2b8c6-ac78-4a31-bae9-42b8e0c62991 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:43.662019 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7cc2b8c6-ac78-4a31-bae9-42b8e0c62991 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:43.662610 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7cc2b8c6-ac78-4a31-bae9-42b8e0c62991 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:43.663613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7cc2b8c6-ac78-4a31-bae9-42b8e0c62991 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:43.674593 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7cc2b8c6-ac78-4a31-bae9-42b8e0c62991 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:43.675288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7cc2b8c6-ac78-4a31-bae9-42b8e0c62991 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:43.780323 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7cc2b8c6-ac78-4a31-bae9-42b8e0c62991 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:43.790931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7cc2b8c6-ac78-4a31-bae9-42b8e0c62991 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1298 microversion: 2.1 time: 0.141590 Sep 16 08:07:43.791690 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 174/323] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:43 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1298 bytes in 143 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:44.061566 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9c4f2629-351d-4ec4-8ec7-89b31c836042 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:44.062670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9c4f2629-351d-4ec4-8ec7-89b31c836042 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:44.073827 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c4f2629-351d-4ec4-8ec7-89b31c836042 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:44.074754 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c4f2629-351d-4ec4-8ec7-89b31c836042 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:44.075401 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c4f2629-351d-4ec4-8ec7-89b31c836042 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:44.076726 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c4f2629-351d-4ec4-8ec7-89b31c836042 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:44.077431 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c4f2629-351d-4ec4-8ec7-89b31c836042 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:44.078078 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c4f2629-351d-4ec4-8ec7-89b31c836042 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:44.125276 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-196970dd-9b0d-4a44-a019-d8d9b3ee0b7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:44.125877 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-196970dd-9b0d-4a44-a019-d8d9b3ee0b7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:44.132880 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-196970dd-9b0d-4a44-a019-d8d9b3ee0b7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:44.133385 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-196970dd-9b0d-4a44-a019-d8d9b3ee0b7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:44.133825 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-196970dd-9b0d-4a44-a019-d8d9b3ee0b7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:44.135033 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-196970dd-9b0d-4a44-a019-d8d9b3ee0b7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:44.139360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-196970dd-9b0d-4a44-a019-d8d9b3ee0b7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:44.139360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-196970dd-9b0d-4a44-a019-d8d9b3ee0b7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:44.315164 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-196970dd-9b0d-4a44-a019-d8d9b3ee0b7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:44.325666 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-196970dd-9b0d-4a44-a019-d8d9b3ee0b7c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.204239 Sep 16 08:07:44.329412 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 175/324] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:44 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:44.335604 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9c4f2629-351d-4ec4-8ec7-89b31c836042 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:44.344097 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9c4f2629-351d-4ec4-8ec7-89b31c836042 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.288085 Sep 16 08:07:44.344660 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 150/325] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:44 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 289 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:44.549467 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-67755c12-1ce4-4bdd-aadf-fe070b63c246 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:44.550748 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-67755c12-1ce4-4bdd-aadf-fe070b63c246 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:44.557640 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67755c12-1ce4-4bdd-aadf-fe070b63c246 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:44.558163 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67755c12-1ce4-4bdd-aadf-fe070b63c246 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:44.558599 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67755c12-1ce4-4bdd-aadf-fe070b63c246 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:44.559353 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67755c12-1ce4-4bdd-aadf-fe070b63c246 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:44.559787 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67755c12-1ce4-4bdd-aadf-fe070b63c246 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:44.560212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67755c12-1ce4-4bdd-aadf-fe070b63c246 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:44.707691 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-67755c12-1ce4-4bdd-aadf-fe070b63c246 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:44.715643 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-67755c12-1ce4-4bdd-aadf-fe070b63c246 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1501 microversion: 2.1 time: 0.170138 Sep 16 08:07:44.716516 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 176/326] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:44 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1501 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:44.739528 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d9cf769f-d00b-4183-b7d7-966ec9080dac tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "532fb2ce-4818-47e6-9ae3-e10f7a589bef"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:44.742511 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d9cf769f-d00b-4183-b7d7-966ec9080dac tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:44.748554 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9cf769f-d00b-4183-b7d7-966ec9080dac tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:44.749043 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9cf769f-d00b-4183-b7d7-966ec9080dac tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:44.749487 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9cf769f-d00b-4183-b7d7-966ec9080dac tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:44.751946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9cf769f-d00b-4183-b7d7-966ec9080dac tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:44.751946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9cf769f-d00b-4183-b7d7-966ec9080dac tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:44.751946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9cf769f-d00b-4183-b7d7-966ec9080dac tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:44.765753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=100 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:44.775172 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-d9cf769f-d00b-4183-b7d7-966ec9080dac tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] HTTP exception thrown: Cannot 'attach_volume' instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 while it is in vm_state rescued Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d9cf769f-d00b-4183-b7d7-966ec9080dac tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Request method failure captured: Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: POST /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058/os-volume_attachments HTTP/1.1 Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 74 Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5GXkI7GeumBIhNBFf_vC-zlSOiV4dCShrtm4bkI4LE1i-bWnSTTdrg8lDXop79dMBvn6k727VeIZ9RUTBYYG88b4loy74GTRNMsNeOg1LluL0TmiejGYMmPZSLUag59Xa3AoJLUqBLHggHqVQT8xsY47QGvGbWk6SSJElkQSuFN5w Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: f143f731c6cc4b38ba979827cd390f77 Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:07:44.777345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:07:44.778947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f143f731c6cc4b38ba979827cd390f77", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:07:44.778947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:07:44.778947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: f143f731c6cc4b38ba979827cd390f77 Sep 16 08:07:44.778947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:07:44.778947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-ServerRescueNegativeTestJSON-481869959-project Sep 16 08:07:44.778947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:07:44.778947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:07:44.778947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: 5a85cff936184b5d94375fd103493950 Sep 16 08:07:44.778947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-ServerRescueNegativeTestJSON-481869959-project Sep 16 08:07:44.778947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Sep 16 08:07:44.778947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {"volumeAttachment": {"volumeId": "532fb2ce-4818-47e6-9ae3-e10f7a589bef"}} Sep 16 08:07:44.778947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Cannot 'attach_volume' instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 while it is in vm_state rescued Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'server_id': 'c6e123e7-4239-4c3a-8e4b-363f1a2bc058', 'body': {'volumeAttachment': {'volumeId': '532fb2ce-4818-47e6-9ae3-e10f7a589bef'}}} Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 in vm_state rescued. Cannot attach_volume while the instance is in this state. Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:07:44.779836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 398, in create Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'attach_volume' instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 while it is in vm_state rescued Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:07:44.781445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:07:44.783206 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:07:44.783206 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:07:44.783206 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'attach_volume' instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 while it is in vm_state rescued Sep 16 08:07:44.783206 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:07:44.783206 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d9cf769f-d00b-4183-b7d7-966ec9080dac tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Returning 409 to user: Cannot 'attach_volume' instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 while it is in vm_state rescued {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:07:44.783206 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d9cf769f-d00b-4183-b7d7-966ec9080dac tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "POST /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058/os-volume_attachments" status: 409 len: 152 microversion: 2.1 time: 0.043937 Sep 16 08:07:44.783206 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 151/327] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:07:44 2022] POST /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058/os-volume_attachments => generated 152 bytes in 45 msecs (HTTP/1.1 409) 9 headers in 378 bytes (1 switches on core 0) Sep 16 08:07:44.788951 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-18739990-1038-4528-adf5-91926b88714e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:44.789477 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-18739990-1038-4528-adf5-91926b88714e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:44.795642 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18739990-1038-4528-adf5-91926b88714e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:44.796121 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18739990-1038-4528-adf5-91926b88714e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:44.797827 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18739990-1038-4528-adf5-91926b88714e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:44.797827 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18739990-1038-4528-adf5-91926b88714e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:44.797827 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18739990-1038-4528-adf5-91926b88714e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:44.798085 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18739990-1038-4528-adf5-91926b88714e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:44.815238 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2a74e5ee-f245-44d1-8462-ea268a531bc4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:44.815934 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2a74e5ee-f245-44d1-8462-ea268a531bc4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:44.821904 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a74e5ee-f245-44d1-8462-ea268a531bc4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:44.822466 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a74e5ee-f245-44d1-8462-ea268a531bc4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:44.823012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a74e5ee-f245-44d1-8462-ea268a531bc4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:44.823791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a74e5ee-f245-44d1-8462-ea268a531bc4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:44.824444 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a74e5ee-f245-44d1-8462-ea268a531bc4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:44.824883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a74e5ee-f245-44d1-8462-ea268a531bc4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:44.963919 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2a74e5ee-f245-44d1-8462-ea268a531bc4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:44.971647 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2a74e5ee-f245-44d1-8462-ea268a531bc4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.160189 Sep 16 08:07:44.972858 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 152/328] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:44 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:45.009726 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-18739990-1038-4528-adf5-91926b88714e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "POST /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058/action" status: 202 len: 0 microversion: 2.1 time: 0.224960 Sep 16 08:07:45.013446 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 177/329] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:07:44 2022] POST /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058/action => generated 0 bytes in 226 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:07:45.019939 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-bfe43edc-35ce-48c6-b9a5-61b13b0a8298 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:45.020586 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-bfe43edc-35ce-48c6-b9a5-61b13b0a8298 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:45.026486 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bfe43edc-35ce-48c6-b9a5-61b13b0a8298 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:45.027012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bfe43edc-35ce-48c6-b9a5-61b13b0a8298 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:45.027455 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bfe43edc-35ce-48c6-b9a5-61b13b0a8298 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:45.028358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bfe43edc-35ce-48c6-b9a5-61b13b0a8298 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:45.028863 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bfe43edc-35ce-48c6-b9a5-61b13b0a8298 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:45.029323 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bfe43edc-35ce-48c6-b9a5-61b13b0a8298 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:45.161568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-bfe43edc-35ce-48c6-b9a5-61b13b0a8298 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:45.170759 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-bfe43edc-35ce-48c6-b9a5-61b13b0a8298 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1509 microversion: 2.1 time: 0.155357 Sep 16 08:07:45.171551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 153/330] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:45 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1509 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:45.350591 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a3cdc173-d762-4db8-bae4-9b189c8ad662 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:45.351595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a3cdc173-d762-4db8-bae4-9b189c8ad662 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:45.357821 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a3cdc173-d762-4db8-bae4-9b189c8ad662 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:45.358663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a3cdc173-d762-4db8-bae4-9b189c8ad662 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:45.359021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a3cdc173-d762-4db8-bae4-9b189c8ad662 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:45.359584 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a3cdc173-d762-4db8-bae4-9b189c8ad662 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:45.360037 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a3cdc173-d762-4db8-bae4-9b189c8ad662 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:45.360466 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a3cdc173-d762-4db8-bae4-9b189c8ad662 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:45.367518 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d9bb4194-4bf4-4324-a686-8f8b0bae78a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:45.368129 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d9bb4194-4bf4-4324-a686-8f8b0bae78a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:45.369973 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:45.375349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9bb4194-4bf4-4324-a686-8f8b0bae78a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:45.375944 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9bb4194-4bf4-4324-a686-8f8b0bae78a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:45.376395 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9bb4194-4bf4-4324-a686-8f8b0bae78a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:45.377105 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9bb4194-4bf4-4324-a686-8f8b0bae78a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:45.377563 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9bb4194-4bf4-4324-a686-8f8b0bae78a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:45.378163 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9bb4194-4bf4-4324-a686-8f8b0bae78a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:45.508467 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a3cdc173-d762-4db8-bae4-9b189c8ad662 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:45.517053 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d9bb4194-4bf4-4324-a686-8f8b0bae78a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:45.521817 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a3cdc173-d762-4db8-bae4-9b189c8ad662 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.175487 Sep 16 08:07:45.522858 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 178/331] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:45 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:45.526039 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d9bb4194-4bf4-4324-a686-8f8b0bae78a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.162260 Sep 16 08:07:45.526592 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 154/332] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:45 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:45.995615 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7afd86a7-7151-4de0-b933-fa22053548a2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:45.996181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7afd86a7-7151-4de0-b933-fa22053548a2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:46.002521 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7afd86a7-7151-4de0-b933-fa22053548a2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:46.007184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7afd86a7-7151-4de0-b933-fa22053548a2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:46.007184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7afd86a7-7151-4de0-b933-fa22053548a2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:46.007184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7afd86a7-7151-4de0-b933-fa22053548a2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:46.007184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7afd86a7-7151-4de0-b933-fa22053548a2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:46.007659 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7afd86a7-7151-4de0-b933-fa22053548a2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:46.136370 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7afd86a7-7151-4de0-b933-fa22053548a2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:46.144269 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7afd86a7-7151-4de0-b933-fa22053548a2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.152656 Sep 16 08:07:46.144830 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 179/333] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:45 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:46.195380 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b2106f8c-6f9a-42da-adca-9a03da2327cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:46.195380 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b2106f8c-6f9a-42da-adca-9a03da2327cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:46.201859 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2106f8c-6f9a-42da-adca-9a03da2327cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:46.202348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2106f8c-6f9a-42da-adca-9a03da2327cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:46.202819 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2106f8c-6f9a-42da-adca-9a03da2327cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:46.204015 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2106f8c-6f9a-42da-adca-9a03da2327cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:46.204169 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2106f8c-6f9a-42da-adca-9a03da2327cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:46.204503 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b2106f8c-6f9a-42da-adca-9a03da2327cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:46.344940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b2106f8c-6f9a-42da-adca-9a03da2327cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:46.353540 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b2106f8c-6f9a-42da-adca-9a03da2327cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1509 microversion: 2.1 time: 0.164277 Sep 16 08:07:46.354105 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 155/334] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:46 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1509 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:46.544880 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c941d877-9d4a-444e-bb55-ba95aba4afcc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:46.545427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c941d877-9d4a-444e-bb55-ba95aba4afcc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:46.549445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5ee3169a-8444-4937-8170-aec8c7064959 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:46.550399 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5ee3169a-8444-4937-8170-aec8c7064959 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:46.552069 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c941d877-9d4a-444e-bb55-ba95aba4afcc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:46.552545 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c941d877-9d4a-444e-bb55-ba95aba4afcc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:46.552983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c941d877-9d4a-444e-bb55-ba95aba4afcc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:46.553678 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c941d877-9d4a-444e-bb55-ba95aba4afcc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:46.554307 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c941d877-9d4a-444e-bb55-ba95aba4afcc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:46.554768 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c941d877-9d4a-444e-bb55-ba95aba4afcc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:46.557103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5ee3169a-8444-4937-8170-aec8c7064959 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:46.557602 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5ee3169a-8444-4937-8170-aec8c7064959 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:46.558037 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5ee3169a-8444-4937-8170-aec8c7064959 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:46.559016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5ee3169a-8444-4937-8170-aec8c7064959 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:46.559477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5ee3169a-8444-4937-8170-aec8c7064959 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:46.560121 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5ee3169a-8444-4937-8170-aec8c7064959 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:46.690280 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c941d877-9d4a-444e-bb55-ba95aba4afcc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:46.698036 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c941d877-9d4a-444e-bb55-ba95aba4afcc tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.157232 Sep 16 08:07:46.698880 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 180/335] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:46 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:46.759615 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5ee3169a-8444-4937-8170-aec8c7064959 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:46.767824 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5ee3169a-8444-4937-8170-aec8c7064959 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.222450 Sep 16 08:07:46.768394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 156/336] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:46 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:47.167452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-de0b5c89-2d36-47d8-9f02-926fed7552b2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:47.168239 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-de0b5c89-2d36-47d8-9f02-926fed7552b2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:47.175561 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-de0b5c89-2d36-47d8-9f02-926fed7552b2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:47.176837 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-de0b5c89-2d36-47d8-9f02-926fed7552b2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:47.177465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-de0b5c89-2d36-47d8-9f02-926fed7552b2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:47.179707 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-de0b5c89-2d36-47d8-9f02-926fed7552b2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:47.180343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-de0b5c89-2d36-47d8-9f02-926fed7552b2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:47.181026 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-de0b5c89-2d36-47d8-9f02-926fed7552b2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:47.356975 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-de0b5c89-2d36-47d8-9f02-926fed7552b2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:47.365386 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-de0b5c89-2d36-47d8-9f02-926fed7552b2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.201851 Sep 16 08:07:47.365964 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 181/337] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:47 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:47.385099 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f0bfe094-74d5-40e8-bde1-4abc9299bacc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:47.385753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f0bfe094-74d5-40e8-bde1-4abc9299bacc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:47.391841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0bfe094-74d5-40e8-bde1-4abc9299bacc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:47.392333 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0bfe094-74d5-40e8-bde1-4abc9299bacc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:47.392775 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0bfe094-74d5-40e8-bde1-4abc9299bacc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:47.393503 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0bfe094-74d5-40e8-bde1-4abc9299bacc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:47.393962 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0bfe094-74d5-40e8-bde1-4abc9299bacc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:47.394396 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0bfe094-74d5-40e8-bde1-4abc9299bacc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:47.721685 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3e0b3ea8-c204-455b-ac1d-35530255c279 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:47.723245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3e0b3ea8-c204-455b-ac1d-35530255c279 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:47.729654 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e0b3ea8-c204-455b-ac1d-35530255c279 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:47.730219 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e0b3ea8-c204-455b-ac1d-35530255c279 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:47.730667 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e0b3ea8-c204-455b-ac1d-35530255c279 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:47.739952 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e0b3ea8-c204-455b-ac1d-35530255c279 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:47.739952 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e0b3ea8-c204-455b-ac1d-35530255c279 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:47.739952 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e0b3ea8-c204-455b-ac1d-35530255c279 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:47.866011 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f0bfe094-74d5-40e8-bde1-4abc9299bacc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:47.875551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f0bfe094-74d5-40e8-bde1-4abc9299bacc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1509 microversion: 2.1 time: 0.502055 Sep 16 08:07:47.876348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 157/338] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:47 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1509 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:47.881787 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3e4b0d46-f44a-4b85-8e49-0def19865a56 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:47.889720 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3e4b0d46-f44a-4b85-8e49-0def19865a56 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:47.913507 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3e4b0d46-f44a-4b85-8e49-0def19865a56 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:47.921590 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3e4b0d46-f44a-4b85-8e49-0def19865a56 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:47.922091 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3e4b0d46-f44a-4b85-8e49-0def19865a56 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:47.924831 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3e4b0d46-f44a-4b85-8e49-0def19865a56 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:47.925324 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3e4b0d46-f44a-4b85-8e49-0def19865a56 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:47.925821 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3e4b0d46-f44a-4b85-8e49-0def19865a56 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:47.949504 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3e0b3ea8-c204-455b-ac1d-35530255c279 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:47.958775 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3e0b3ea8-c204-455b-ac1d-35530255c279 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.241084 Sep 16 08:07:47.959469 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 182/339] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:47 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:48.195531 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3e4b0d46-f44a-4b85-8e49-0def19865a56 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:48.204186 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3e4b0d46-f44a-4b85-8e49-0def19865a56 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.326791 Sep 16 08:07:48.204938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 158/340] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:47 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 328 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:48.289321 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-2db0663a-a794-47ae-ac14-2543a98c8d39 req-b7535e82-f3e9-40ee-9015-b46a617fabac service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6372a5c9-25ed-4593-861f-78a0f8cf03ce", "tag": "0587b75f-a06f-40a0-8e4d-3ac7308fa48a"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:48.299929 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-2db0663a-a794-47ae-ac14-2543a98c8d39 req-b7535e82-f3e9-40ee-9015-b46a617fabac service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:48.301595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-2db0663a-a794-47ae-ac14-2543a98c8d39 req-b7535e82-f3e9-40ee-9015-b46a617fabac service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:48.302032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-2db0663a-a794-47ae-ac14-2543a98c8d39 req-b7535e82-f3e9-40ee-9015-b46a617fabac service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:48.314549 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-2db0663a-a794-47ae-ac14-2543a98c8d39 req-b7535e82-f3e9-40ee-9015-b46a617fabac service nova] Creating event network-changed:0587b75f-a06f-40a0-8e4d-3ac7308fa48a for instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce on hv-cinder-74014 Sep 16 08:07:48.321340 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-2db0663a-a794-47ae-ac14-2543a98c8d39 req-b7535e82-f3e9-40ee-9015-b46a617fabac service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.036570 Sep 16 08:07:48.322344 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 183/341] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:07:48 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:07:48.388766 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f41f1b0c-c43d-4621-835c-aef15244772c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:48.389326 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f41f1b0c-c43d-4621-835c-aef15244772c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:48.395627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f41f1b0c-c43d-4621-835c-aef15244772c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:48.396102 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f41f1b0c-c43d-4621-835c-aef15244772c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:48.396532 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f41f1b0c-c43d-4621-835c-aef15244772c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:48.397214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f41f1b0c-c43d-4621-835c-aef15244772c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:48.397661 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f41f1b0c-c43d-4621-835c-aef15244772c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:48.398245 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f41f1b0c-c43d-4621-835c-aef15244772c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:48.548408 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f41f1b0c-c43d-4621-835c-aef15244772c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:48.548408 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f41f1b0c-c43d-4621-835c-aef15244772c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.156002 Sep 16 08:07:48.548408 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 159/342] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:48 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:48.900687 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3c77278b-12bd-458a-93ce-3b4433f0f064 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:48.902699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3c77278b-12bd-458a-93ce-3b4433f0f064 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:48.920357 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c77278b-12bd-458a-93ce-3b4433f0f064 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:48.921235 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c77278b-12bd-458a-93ce-3b4433f0f064 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:48.921875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c77278b-12bd-458a-93ce-3b4433f0f064 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:48.923679 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c77278b-12bd-458a-93ce-3b4433f0f064 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:48.925010 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c77278b-12bd-458a-93ce-3b4433f0f064 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:48.926151 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c77278b-12bd-458a-93ce-3b4433f0f064 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:48.981387 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-97c6dc53-ec9b-448b-9ee9-e8af1c6f95ae tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:48.981999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-97c6dc53-ec9b-448b-9ee9-e8af1c6f95ae tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:48.988188 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-97c6dc53-ec9b-448b-9ee9-e8af1c6f95ae tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:48.988937 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-97c6dc53-ec9b-448b-9ee9-e8af1c6f95ae tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:48.989376 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-97c6dc53-ec9b-448b-9ee9-e8af1c6f95ae tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:48.990457 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-97c6dc53-ec9b-448b-9ee9-e8af1c6f95ae tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:48.990941 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-97c6dc53-ec9b-448b-9ee9-e8af1c6f95ae tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:48.992294 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-97c6dc53-ec9b-448b-9ee9-e8af1c6f95ae tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:49.099612 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3c77278b-12bd-458a-93ce-3b4433f0f064 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:49.108562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3c77278b-12bd-458a-93ce-3b4433f0f064 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1509 microversion: 2.1 time: 0.212447 Sep 16 08:07:49.109668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 184/343] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:48 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1509 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:49.195331 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-97c6dc53-ec9b-448b-9ee9-e8af1c6f95ae tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:49.204357 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-97c6dc53-ec9b-448b-9ee9-e8af1c6f95ae tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.226304 Sep 16 08:07:49.205029 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 160/344] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:48 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:49.228625 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-74997e8f-6965-4b5f-84cd-63a574a87d4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:49.229244 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-74997e8f-6965-4b5f-84cd-63a574a87d4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:49.235610 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74997e8f-6965-4b5f-84cd-63a574a87d4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:49.236108 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74997e8f-6965-4b5f-84cd-63a574a87d4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:49.236550 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74997e8f-6965-4b5f-84cd-63a574a87d4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:49.237253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74997e8f-6965-4b5f-84cd-63a574a87d4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:49.237710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74997e8f-6965-4b5f-84cd-63a574a87d4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:49.238246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74997e8f-6965-4b5f-84cd-63a574a87d4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:49.387301 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-74997e8f-6965-4b5f-84cd-63a574a87d4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:49.396242 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-74997e8f-6965-4b5f-84cd-63a574a87d4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.171038 Sep 16 08:07:49.397697 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 185/345] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:49 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:49.567570 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ce12f441-b7c2-4552-bfac-44adea0310a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:49.568285 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ce12f441-b7c2-4552-bfac-44adea0310a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:49.575077 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ce12f441-b7c2-4552-bfac-44adea0310a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:49.576264 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ce12f441-b7c2-4552-bfac-44adea0310a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:49.576264 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ce12f441-b7c2-4552-bfac-44adea0310a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:49.576849 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ce12f441-b7c2-4552-bfac-44adea0310a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:49.577438 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ce12f441-b7c2-4552-bfac-44adea0310a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:49.577874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ce12f441-b7c2-4552-bfac-44adea0310a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:49.717207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ce12f441-b7c2-4552-bfac-44adea0310a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:49.724978 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ce12f441-b7c2-4552-bfac-44adea0310a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.162189 Sep 16 08:07:49.726005 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 161/346] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:49 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:50.131919 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9d9cd74d-42b4-4b20-a7bc-29dbb10edee4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:50.132533 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-9d9cd74d-42b4-4b20-a7bc-29dbb10edee4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:50.139081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9d9cd74d-42b4-4b20-a7bc-29dbb10edee4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:50.139596 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9d9cd74d-42b4-4b20-a7bc-29dbb10edee4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:50.140019 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9d9cd74d-42b4-4b20-a7bc-29dbb10edee4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:50.144212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9d9cd74d-42b4-4b20-a7bc-29dbb10edee4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:50.144733 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9d9cd74d-42b4-4b20-a7bc-29dbb10edee4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:50.145171 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9d9cd74d-42b4-4b20-a7bc-29dbb10edee4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:50.229783 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7ae44286-9470-4920-b45f-af5d14084e64 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:50.229783 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7ae44286-9470-4920-b45f-af5d14084e64 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:50.239268 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ae44286-9470-4920-b45f-af5d14084e64 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:50.239860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ae44286-9470-4920-b45f-af5d14084e64 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:50.241061 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ae44286-9470-4920-b45f-af5d14084e64 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:50.243638 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ae44286-9470-4920-b45f-af5d14084e64 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:50.244359 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ae44286-9470-4920-b45f-af5d14084e64 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:50.245040 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ae44286-9470-4920-b45f-af5d14084e64 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:50.348648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-9d9cd74d-42b4-4b20-a7bc-29dbb10edee4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:50.358333 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9d9cd74d-42b4-4b20-a7bc-29dbb10edee4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1509 microversion: 2.1 time: 0.230237 Sep 16 08:07:50.359062 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 186/347] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:50 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1509 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:50.420689 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-29c86f18-bb71-4a3e-8fd5-de0106ab6fc8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:50.421996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-29c86f18-bb71-4a3e-8fd5-de0106ab6fc8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:50.430386 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-29c86f18-bb71-4a3e-8fd5-de0106ab6fc8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:50.430915 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-29c86f18-bb71-4a3e-8fd5-de0106ab6fc8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:50.431639 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-29c86f18-bb71-4a3e-8fd5-de0106ab6fc8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:50.432512 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-29c86f18-bb71-4a3e-8fd5-de0106ab6fc8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:50.433120 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-29c86f18-bb71-4a3e-8fd5-de0106ab6fc8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:50.433961 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-29c86f18-bb71-4a3e-8fd5-de0106ab6fc8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:50.463283 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:50.472111 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7ae44286-9470-4920-b45f-af5d14084e64 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:50.481477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7ae44286-9470-4920-b45f-af5d14084e64 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.256492 Sep 16 08:07:50.483334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 162/348] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:50 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 259 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:50.588024 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-29c86f18-bb71-4a3e-8fd5-de0106ab6fc8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:50.598259 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-29c86f18-bb71-4a3e-8fd5-de0106ab6fc8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.182486 Sep 16 08:07:50.598860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 187/349] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:50 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:50.749887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5f79f1fa-a56b-46dd-ad2d-1cc75ab58e00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:50.751125 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5f79f1fa-a56b-46dd-ad2d-1cc75ab58e00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:50.758581 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5f79f1fa-a56b-46dd-ad2d-1cc75ab58e00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:50.759124 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5f79f1fa-a56b-46dd-ad2d-1cc75ab58e00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:50.759561 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5f79f1fa-a56b-46dd-ad2d-1cc75ab58e00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:50.760266 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5f79f1fa-a56b-46dd-ad2d-1cc75ab58e00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:50.760880 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5f79f1fa-a56b-46dd-ad2d-1cc75ab58e00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:50.761305 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5f79f1fa-a56b-46dd-ad2d-1cc75ab58e00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:50.974159 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5f79f1fa-a56b-46dd-ad2d-1cc75ab58e00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:50.982553 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5f79f1fa-a56b-46dd-ad2d-1cc75ab58e00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.236904 Sep 16 08:07:50.994774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 163/350] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:50 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:51.138482 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-ab4e0bca-d271-4d65-8649-c2610df7e5e6 req-053b0576-880b-4e47-833f-8f30c60f699d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998c37d2-18ab-459f-a9d6-bf19c51fb695", "name": "network-vif-plugged", "status": "completed", "tag": "800c16c0-6c80-47ad-8a9f-a60246ce9a01"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:51.153853 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-ab4e0bca-d271-4d65-8649-c2610df7e5e6 req-053b0576-880b-4e47-833f-8f30c60f699d service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:51.153853 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-ab4e0bca-d271-4d65-8649-c2610df7e5e6 req-053b0576-880b-4e47-833f-8f30c60f699d service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:51.153853 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-ab4e0bca-d271-4d65-8649-c2610df7e5e6 req-053b0576-880b-4e47-833f-8f30c60f699d service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:51.164206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-ab4e0bca-d271-4d65-8649-c2610df7e5e6 req-053b0576-880b-4e47-833f-8f30c60f699d service nova] Creating event network-vif-plugged:800c16c0-6c80-47ad-8a9f-a60246ce9a01 for instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 on hv-cinder-74014 Sep 16 08:07:51.169195 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-ab4e0bca-d271-4d65-8649-c2610df7e5e6 req-053b0576-880b-4e47-833f-8f30c60f699d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035471 Sep 16 08:07:51.170213 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 188/351] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:07:51 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:07:51.385303 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1570a55c-4f43-4cdf-affb-6c9719bc39f4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:51.385921 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1570a55c-4f43-4cdf-affb-6c9719bc39f4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:51.391961 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1570a55c-4f43-4cdf-affb-6c9719bc39f4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:51.392468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1570a55c-4f43-4cdf-affb-6c9719bc39f4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:51.397568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1570a55c-4f43-4cdf-affb-6c9719bc39f4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:51.397568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1570a55c-4f43-4cdf-affb-6c9719bc39f4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:51.397568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1570a55c-4f43-4cdf-affb-6c9719bc39f4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:51.397568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1570a55c-4f43-4cdf-affb-6c9719bc39f4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:51.506099 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2de332f2-0210-4a24-988c-3875a3f47219 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:51.507325 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2de332f2-0210-4a24-988c-3875a3f47219 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:51.521448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2de332f2-0210-4a24-988c-3875a3f47219 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:51.522188 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2de332f2-0210-4a24-988c-3875a3f47219 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:51.522820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2de332f2-0210-4a24-988c-3875a3f47219 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:51.523757 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2de332f2-0210-4a24-988c-3875a3f47219 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:51.524384 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2de332f2-0210-4a24-988c-3875a3f47219 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:51.524972 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2de332f2-0210-4a24-988c-3875a3f47219 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:51.555248 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1570a55c-4f43-4cdf-affb-6c9719bc39f4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:51.576812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1570a55c-4f43-4cdf-affb-6c9719bc39f4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1509 microversion: 2.1 time: 0.197537 Sep 16 08:07:51.578059 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 164/352] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:51 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1509 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:51.622151 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f7f2c1eb-b574-4a60-a9e0-26182e197408 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:51.622958 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f7f2c1eb-b574-4a60-a9e0-26182e197408 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:51.631871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7f2c1eb-b574-4a60-a9e0-26182e197408 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:51.632659 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7f2c1eb-b574-4a60-a9e0-26182e197408 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:51.633051 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7f2c1eb-b574-4a60-a9e0-26182e197408 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:51.633822 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7f2c1eb-b574-4a60-a9e0-26182e197408 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:51.634282 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7f2c1eb-b574-4a60-a9e0-26182e197408 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:51.634812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7f2c1eb-b574-4a60-a9e0-26182e197408 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:51.707380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2de332f2-0210-4a24-988c-3875a3f47219 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:51.715963 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2de332f2-0210-4a24-988c-3875a3f47219 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.215005 Sep 16 08:07:51.719089 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 189/353] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:51 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:51.861127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f7f2c1eb-b574-4a60-a9e0-26182e197408 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:51.870603 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f7f2c1eb-b574-4a60-a9e0-26182e197408 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.252628 Sep 16 08:07:51.871226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 165/354] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:51 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 254 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:52.007631 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-598bb943-d2c9-4269-b463-630ca4207852 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:52.008282 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-598bb943-d2c9-4269-b463-630ca4207852 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:52.014484 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-598bb943-d2c9-4269-b463-630ca4207852 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:52.015014 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-598bb943-d2c9-4269-b463-630ca4207852 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:52.015460 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-598bb943-d2c9-4269-b463-630ca4207852 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:52.016160 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-598bb943-d2c9-4269-b463-630ca4207852 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:52.016620 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-598bb943-d2c9-4269-b463-630ca4207852 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:52.017055 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-598bb943-d2c9-4269-b463-630ca4207852 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:52.151248 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-598bb943-d2c9-4269-b463-630ca4207852 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:52.159185 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-598bb943-d2c9-4269-b463-630ca4207852 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.155762 Sep 16 08:07:52.159756 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 190/355] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:52 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:52.600531 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ca61f451-6a67-4fc1-826f-858c77458141 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:52.601147 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ca61f451-6a67-4fc1-826f-858c77458141 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:52.607309 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ca61f451-6a67-4fc1-826f-858c77458141 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:52.607791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ca61f451-6a67-4fc1-826f-858c77458141 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:52.608230 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ca61f451-6a67-4fc1-826f-858c77458141 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:52.608922 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ca61f451-6a67-4fc1-826f-858c77458141 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:52.609380 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ca61f451-6a67-4fc1-826f-858c77458141 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:52.609803 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ca61f451-6a67-4fc1-826f-858c77458141 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:52.741964 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1b5e5f05-3d89-487e-8ea3-cfa8f1b1b72c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:52.742575 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1b5e5f05-3d89-487e-8ea3-cfa8f1b1b72c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:52.748375 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ca61f451-6a67-4fc1-826f-858c77458141 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:52.748811 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1b5e5f05-3d89-487e-8ea3-cfa8f1b1b72c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:52.749296 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1b5e5f05-3d89-487e-8ea3-cfa8f1b1b72c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:52.749952 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1b5e5f05-3d89-487e-8ea3-cfa8f1b1b72c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:52.750725 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1b5e5f05-3d89-487e-8ea3-cfa8f1b1b72c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:52.751186 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1b5e5f05-3d89-487e-8ea3-cfa8f1b1b72c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:52.751613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1b5e5f05-3d89-487e-8ea3-cfa8f1b1b72c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:52.757585 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ca61f451-6a67-4fc1-826f-858c77458141 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1515 microversion: 2.1 time: 0.161162 Sep 16 08:07:52.758275 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 166/356] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:52 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1515 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:52.884933 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1b5e5f05-3d89-487e-8ea3-cfa8f1b1b72c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:52.894563 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-05933878-d13a-4374-b14d-6120839096ef tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:52.895187 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1b5e5f05-3d89-487e-8ea3-cfa8f1b1b72c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.156500 Sep 16 08:07:52.896194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-05933878-d13a-4374-b14d-6120839096ef tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:52.897312 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 191/357] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:52 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:52.903404 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05933878-d13a-4374-b14d-6120839096ef tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:52.903887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05933878-d13a-4374-b14d-6120839096ef tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:52.904318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05933878-d13a-4374-b14d-6120839096ef tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:52.911348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05933878-d13a-4374-b14d-6120839096ef tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:52.911348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05933878-d13a-4374-b14d-6120839096ef tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:52.911348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05933878-d13a-4374-b14d-6120839096ef tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:53.048165 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-05933878-d13a-4374-b14d-6120839096ef tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:53.057228 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-05933878-d13a-4374-b14d-6120839096ef tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.167787 Sep 16 08:07:53.057797 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 167/358] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:52 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:53.182224 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c7e6bf17-0097-4e6b-850e-d273317e2cfc tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:53.182858 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c7e6bf17-0097-4e6b-850e-d273317e2cfc tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:53.188817 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c7e6bf17-0097-4e6b-850e-d273317e2cfc tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:53.189299 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c7e6bf17-0097-4e6b-850e-d273317e2cfc tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:53.189733 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c7e6bf17-0097-4e6b-850e-d273317e2cfc tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:53.190614 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c7e6bf17-0097-4e6b-850e-d273317e2cfc tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:53.191129 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c7e6bf17-0097-4e6b-850e-d273317e2cfc tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:53.191558 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c7e6bf17-0097-4e6b-850e-d273317e2cfc tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:53.325592 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c7e6bf17-0097-4e6b-850e-d273317e2cfc tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:53.333494 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c7e6bf17-0097-4e6b-850e-d273317e2cfc tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.155239 Sep 16 08:07:53.334066 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 192/359] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:53 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:53.922292 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-042be35c-11e3-4756-98d4-4a8b828faef9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:53.923052 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-042be35c-11e3-4756-98d4-4a8b828faef9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:53.929450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-042be35c-11e3-4756-98d4-4a8b828faef9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:53.929955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-042be35c-11e3-4756-98d4-4a8b828faef9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:53.930389 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-042be35c-11e3-4756-98d4-4a8b828faef9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:53.931101 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-042be35c-11e3-4756-98d4-4a8b828faef9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:53.931550 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-042be35c-11e3-4756-98d4-4a8b828faef9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:53.931974 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-042be35c-11e3-4756-98d4-4a8b828faef9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:53.946974 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=100 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:07:54.063298 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-042be35c-11e3-4756-98d4-4a8b828faef9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:54.071000 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-042be35c-11e3-4756-98d4-4a8b828faef9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.152472 Sep 16 08:07:54.071555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 168/360] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:53 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:54.081166 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-298a64c4-fa9d-4b0e-8bc8-16e5cabd093e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:54.081774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-298a64c4-fa9d-4b0e-8bc8-16e5cabd093e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:54.088706 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-298a64c4-fa9d-4b0e-8bc8-16e5cabd093e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:54.089187 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-298a64c4-fa9d-4b0e-8bc8-16e5cabd093e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:54.089626 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-298a64c4-fa9d-4b0e-8bc8-16e5cabd093e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:54.090330 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-298a64c4-fa9d-4b0e-8bc8-16e5cabd093e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:54.090797 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-298a64c4-fa9d-4b0e-8bc8-16e5cabd093e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:54.091223 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-298a64c4-fa9d-4b0e-8bc8-16e5cabd093e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:54.220237 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-298a64c4-fa9d-4b0e-8bc8-16e5cabd093e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:54.229034 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-298a64c4-fa9d-4b0e-8bc8-16e5cabd093e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.151680 Sep 16 08:07:54.229597 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 193/361] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:54 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:54.356657 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6dc1c6a1-9c40-48d9-8ff9-cb33d9e2f3e3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:54.357379 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6dc1c6a1-9c40-48d9-8ff9-cb33d9e2f3e3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:54.364443 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6dc1c6a1-9c40-48d9-8ff9-cb33d9e2f3e3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:54.364930 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6dc1c6a1-9c40-48d9-8ff9-cb33d9e2f3e3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:54.367433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6dc1c6a1-9c40-48d9-8ff9-cb33d9e2f3e3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:54.368158 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6dc1c6a1-9c40-48d9-8ff9-cb33d9e2f3e3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:54.368628 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6dc1c6a1-9c40-48d9-8ff9-cb33d9e2f3e3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:54.369063 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6dc1c6a1-9c40-48d9-8ff9-cb33d9e2f3e3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:54.499291 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6dc1c6a1-9c40-48d9-8ff9-cb33d9e2f3e3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:54.507278 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6dc1c6a1-9c40-48d9-8ff9-cb33d9e2f3e3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.154913 Sep 16 08:07:54.507852 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 169/362] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:54 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:55.093645 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-20291a58-7736-46b8-8617-50f63df8d487 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:55.094635 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-20291a58-7736-46b8-8617-50f63df8d487 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:55.101160 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-20291a58-7736-46b8-8617-50f63df8d487 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:55.101644 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-20291a58-7736-46b8-8617-50f63df8d487 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:55.102081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-20291a58-7736-46b8-8617-50f63df8d487 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:55.102810 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-20291a58-7736-46b8-8617-50f63df8d487 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:55.103262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-20291a58-7736-46b8-8617-50f63df8d487 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:55.103688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-20291a58-7736-46b8-8617-50f63df8d487 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:55.239337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-20291a58-7736-46b8-8617-50f63df8d487 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:55.247173 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-20291a58-7736-46b8-8617-50f63df8d487 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.157647 Sep 16 08:07:55.247742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 194/363] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:55 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:55.252834 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4dccef84-51ec-4903-8e4d-ebc463698b2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:55.253576 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4dccef84-51ec-4903-8e4d-ebc463698b2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:55.260910 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4dccef84-51ec-4903-8e4d-ebc463698b2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:55.261523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4dccef84-51ec-4903-8e4d-ebc463698b2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:55.261959 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4dccef84-51ec-4903-8e4d-ebc463698b2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:55.262815 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4dccef84-51ec-4903-8e4d-ebc463698b2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:55.263142 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4dccef84-51ec-4903-8e4d-ebc463698b2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:55.263596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4dccef84-51ec-4903-8e4d-ebc463698b2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:55.392886 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-4dccef84-51ec-4903-8e4d-ebc463698b2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:55.401567 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4dccef84-51ec-4903-8e4d-ebc463698b2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.152681 Sep 16 08:07:55.402142 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 170/364] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:55 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:55.529399 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-034fcf75-c3b0-4f24-ad2e-87996b3ee3b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:55.529971 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-034fcf75-c3b0-4f24-ad2e-87996b3ee3b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:55.536424 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-034fcf75-c3b0-4f24-ad2e-87996b3ee3b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:55.536914 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-034fcf75-c3b0-4f24-ad2e-87996b3ee3b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:55.537353 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-034fcf75-c3b0-4f24-ad2e-87996b3ee3b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:55.538048 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-034fcf75-c3b0-4f24-ad2e-87996b3ee3b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:55.538507 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-034fcf75-c3b0-4f24-ad2e-87996b3ee3b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:55.538975 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-034fcf75-c3b0-4f24-ad2e-87996b3ee3b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:55.675464 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-034fcf75-c3b0-4f24-ad2e-87996b3ee3b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:55.683308 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-034fcf75-c3b0-4f24-ad2e-87996b3ee3b0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.157816 Sep 16 08:07:55.683916 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 195/365] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:55 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:56.270030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-cfe2200b-9243-4b18-9184-56186a0f629a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:56.270642 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-cfe2200b-9243-4b18-9184-56186a0f629a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:56.277198 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cfe2200b-9243-4b18-9184-56186a0f629a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:56.277677 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cfe2200b-9243-4b18-9184-56186a0f629a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:56.278215 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cfe2200b-9243-4b18-9184-56186a0f629a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:56.278957 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cfe2200b-9243-4b18-9184-56186a0f629a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:56.279425 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cfe2200b-9243-4b18-9184-56186a0f629a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:56.279831 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cfe2200b-9243-4b18-9184-56186a0f629a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:56.425456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5db4f416-1432-45ba-a6a8-4d7529e2b550 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:56.426070 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5db4f416-1432-45ba-a6a8-4d7529e2b550 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:56.433624 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5db4f416-1432-45ba-a6a8-4d7529e2b550 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:56.434110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5db4f416-1432-45ba-a6a8-4d7529e2b550 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:56.434541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5db4f416-1432-45ba-a6a8-4d7529e2b550 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:56.435262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5db4f416-1432-45ba-a6a8-4d7529e2b550 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:56.435709 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5db4f416-1432-45ba-a6a8-4d7529e2b550 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:56.436128 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5db4f416-1432-45ba-a6a8-4d7529e2b550 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:56.464696 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cfe2200b-9243-4b18-9184-56186a0f629a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:56.473917 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-cfe2200b-9243-4b18-9184-56186a0f629a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.207074 Sep 16 08:07:56.474642 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 171/366] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:56 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:56.573308 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5db4f416-1432-45ba-a6a8-4d7529e2b550 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:56.581607 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5db4f416-1432-45ba-a6a8-4d7529e2b550 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.160066 Sep 16 08:07:56.582174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 196/367] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:56 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:56.705292 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-64c10a5b-b51e-4a0d-8dd7-195598c48f64 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:56.705904 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-64c10a5b-b51e-4a0d-8dd7-195598c48f64 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:56.712512 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-64c10a5b-b51e-4a0d-8dd7-195598c48f64 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:56.712999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-64c10a5b-b51e-4a0d-8dd7-195598c48f64 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:56.713439 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-64c10a5b-b51e-4a0d-8dd7-195598c48f64 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:56.714140 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-64c10a5b-b51e-4a0d-8dd7-195598c48f64 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:56.714593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-64c10a5b-b51e-4a0d-8dd7-195598c48f64 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:56.715161 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-64c10a5b-b51e-4a0d-8dd7-195598c48f64 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:56.917259 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-64c10a5b-b51e-4a0d-8dd7-195598c48f64 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:56.925106 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-64c10a5b-b51e-4a0d-8dd7-195598c48f64 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.223629 Sep 16 08:07:56.925686 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 172/368] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:56 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:57.500299 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-343b829e-4d7f-49b9-bfd8-ba1657e4781d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:57.501737 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-343b829e-4d7f-49b9-bfd8-ba1657e4781d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:57.509303 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-343b829e-4d7f-49b9-bfd8-ba1657e4781d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:57.512331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-343b829e-4d7f-49b9-bfd8-ba1657e4781d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:57.512331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-343b829e-4d7f-49b9-bfd8-ba1657e4781d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:57.512331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-343b829e-4d7f-49b9-bfd8-ba1657e4781d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:57.512331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-343b829e-4d7f-49b9-bfd8-ba1657e4781d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:57.512715 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-343b829e-4d7f-49b9-bfd8-ba1657e4781d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:57.606109 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-298e6496-d80c-4158-b746-975afeb8f015 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:57.606966 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-298e6496-d80c-4158-b746-975afeb8f015 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:57.615679 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e6496-d80c-4158-b746-975afeb8f015 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:57.616274 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e6496-d80c-4158-b746-975afeb8f015 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:57.616861 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e6496-d80c-4158-b746-975afeb8f015 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:57.617661 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e6496-d80c-4158-b746-975afeb8f015 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:57.618197 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e6496-d80c-4158-b746-975afeb8f015 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:57.618744 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e6496-d80c-4158-b746-975afeb8f015 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:57.664179 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-343b829e-4d7f-49b9-bfd8-ba1657e4781d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:57.674257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-343b829e-4d7f-49b9-bfd8-ba1657e4781d tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1358 microversion: 2.1 time: 0.180072 Sep 16 08:07:57.675838 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 197/369] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:57 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1358 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:57.788177 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-83aa3a67-5aac-49ee-95cc-308a670c8e59 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Action: 'create', calling method: .version_select at 0x7f9d06bcc820>, body: {"keypair": {"name": "tempest-keypair-1395195768", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBFWNiVXyhCx6L2o87ySDvsTPLu8ec9V+JbV6bOQy5AYIYziyyQFmj/u0DhZfWbjCTSXyiIwoVXPZ78Jv681o15fUHl0FdCG3f6MVQneJSDvDqGpGvsu6YzoyvFqpIXpHpw=="}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:07:57.805828 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-83aa3a67-5aac-49ee-95cc-308a670c8e59 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Getting quotas for project f143f731c6cc4b38ba979827cd390f77. Resources: {'key_pairs'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:07:57.810673 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-83aa3a67-5aac-49ee-95cc-308a670c8e59 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Getting quotas for user 5a85cff936184b5d94375fd103493950 and project f143f731c6cc4b38ba979827cd390f77. Resources: {'key_pairs'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:07:57.905726 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-298e6496-d80c-4158-b746-975afeb8f015 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:57.923722 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-298e6496-d80c-4158-b746-975afeb8f015 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.322105 Sep 16 08:07:57.925035 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 173/370] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:57 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:57.938863 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-83aa3a67-5aac-49ee-95cc-308a670c8e59 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.155914 Sep 16 08:07:57.939924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 198/371] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Sep 16 08:07:57 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:07:57.950822 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2ec4a553-00ff-4026-a2ee-7c8f5849eaae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:57.951621 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2ec4a553-00ff-4026-a2ee-7c8f5849eaae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:57.966244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2ec4a553-00ff-4026-a2ee-7c8f5849eaae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:57.967015 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2ec4a553-00ff-4026-a2ee-7c8f5849eaae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:57.967606 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2ec4a553-00ff-4026-a2ee-7c8f5849eaae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:57.968648 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2ec4a553-00ff-4026-a2ee-7c8f5849eaae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:57.969367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2ec4a553-00ff-4026-a2ee-7c8f5849eaae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:57.969944 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2ec4a553-00ff-4026-a2ee-7c8f5849eaae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:58.219785 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2ec4a553-00ff-4026-a2ee-7c8f5849eaae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:58.228468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2ec4a553-00ff-4026-a2ee-7c8f5849eaae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.281392 Sep 16 08:07:58.229143 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 174/372] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:57 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 283 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:58.702443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-54604b95-dfb7-49c7-854b-d1b648d61061 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:58.703317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-54604b95-dfb7-49c7-854b-d1b648d61061 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:58.711020 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-54604b95-dfb7-49c7-854b-d1b648d61061 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:58.711522 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-54604b95-dfb7-49c7-854b-d1b648d61061 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:58.711965 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-54604b95-dfb7-49c7-854b-d1b648d61061 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:58.712714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-54604b95-dfb7-49c7-854b-d1b648d61061 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:58.713240 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-54604b95-dfb7-49c7-854b-d1b648d61061 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:58.713676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-54604b95-dfb7-49c7-854b-d1b648d61061 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:58.867385 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-54604b95-dfb7-49c7-854b-d1b648d61061 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:58.876459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-54604b95-dfb7-49c7-854b-d1b648d61061 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1547 microversion: 2.1 time: 0.178487 Sep 16 08:07:58.877056 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 199/373] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:58 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1547 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:58.902472 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-25268729-9a95-4a97-9b35-4f3262c80e7f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:58.903862 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-25268729-9a95-4a97-9b35-4f3262c80e7f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:58.912340 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-25268729-9a95-4a97-9b35-4f3262c80e7f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:58.912841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-25268729-9a95-4a97-9b35-4f3262c80e7f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:58.913283 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-25268729-9a95-4a97-9b35-4f3262c80e7f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:58.914500 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-25268729-9a95-4a97-9b35-4f3262c80e7f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:58.915292 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-25268729-9a95-4a97-9b35-4f3262c80e7f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:58.915727 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-25268729-9a95-4a97-9b35-4f3262c80e7f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:58.949226 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5f4e6486-d5b8-45a9-89ec-bd60c58a69a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:58.950625 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5f4e6486-d5b8-45a9-89ec-bd60c58a69a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:58.962219 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f4e6486-d5b8-45a9-89ec-bd60c58a69a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:58.962756 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f4e6486-d5b8-45a9-89ec-bd60c58a69a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:58.963206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f4e6486-d5b8-45a9-89ec-bd60c58a69a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:58.963923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f4e6486-d5b8-45a9-89ec-bd60c58a69a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:58.964568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f4e6486-d5b8-45a9-89ec-bd60c58a69a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:58.966061 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f4e6486-d5b8-45a9-89ec-bd60c58a69a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:59.135309 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5f4e6486-d5b8-45a9-89ec-bd60c58a69a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:59.151421 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5f4e6486-d5b8-45a9-89ec-bd60c58a69a8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.207407 Sep 16 08:07:59.154968 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 200/374] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:58 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:07:59.253755 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8b88fceb-76a8-49d1-8c54-f9cdb8dd9031 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:59.254938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8b88fceb-76a8-49d1-8c54-f9cdb8dd9031 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:59.261408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8b88fceb-76a8-49d1-8c54-f9cdb8dd9031 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:59.263322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8b88fceb-76a8-49d1-8c54-f9cdb8dd9031 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:59.263322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8b88fceb-76a8-49d1-8c54-f9cdb8dd9031 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:59.263322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8b88fceb-76a8-49d1-8c54-f9cdb8dd9031 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:59.263804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8b88fceb-76a8-49d1-8c54-f9cdb8dd9031 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:59.264400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8b88fceb-76a8-49d1-8c54-f9cdb8dd9031 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:59.321421 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-25268729-9a95-4a97-9b35-4f3262c80e7f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:59.335893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-25268729-9a95-4a97-9b35-4f3262c80e7f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1547 microversion: 2.1 time: 0.437121 Sep 16 08:07:59.338215 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 175/375] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:58 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1547 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:59.366746 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-502acad3-2067-4a8e-8b36-63b9bee19e0f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:59.379901 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-502acad3-2067-4a8e-8b36-63b9bee19e0f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:servers:allow_all_filters failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:59.381043 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-502acad3-2067-4a8e-8b36-63b9bee19e0f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Searching by: {'deleted': False, 'project_id': '5870af1bbad64b138178c47e4a571d81'} {{(pid=121047) get_all /opt/stack/nova/nova/compute/api.py:3017}} Sep 16 08:07:59.389381 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-502acad3-2067-4a8e-8b36-63b9bee19e0f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:59.390101 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-502acad3-2067-4a8e-8b36-63b9bee19e0f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:59.390710 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-502acad3-2067-4a8e-8b36-63b9bee19e0f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:59.391662 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-502acad3-2067-4a8e-8b36-63b9bee19e0f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:59.393014 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-502acad3-2067-4a8e-8b36-63b9bee19e0f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:59.393648 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-502acad3-2067-4a8e-8b36-63b9bee19e0f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:59.437015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8b88fceb-76a8-49d1-8c54-f9cdb8dd9031 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:59.448098 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8b88fceb-76a8-49d1-8c54-f9cdb8dd9031 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.198532 Sep 16 08:07:59.464523 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 201/376] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:59 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:07:59.514068 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.multi_cell_list [None req-502acad3-2067-4a8e-8b36-63b9bee19e0f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Listed batch of 1 results from cell out of 1000 limit. Returned 1 total so far. {{(pid=121047) do_query /opt/stack/nova/nova/compute/multi_cell_list.py:373}} Sep 16 08:07:59.621682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-502acad3-2067-4a8e-8b36-63b9bee19e0f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers" status: 200 len: 343 microversion: 2.1 time: 0.263111 Sep 16 08:07:59.622274 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 176/377] 10.222.0.59 () {58 vars in 1125 bytes} [Fri Sep 16 08:07:59 2022] GET /compute/v2.1/servers => generated 343 bytes in 265 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:07:59.636362 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ba037994-d49a-46c8-9bb7-11d80a74e253 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:07:59.637420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ba037994-d49a-46c8-9bb7-11d80a74e253 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:07:59.646349 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ba037994-d49a-46c8-9bb7-11d80a74e253 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:59.647029 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ba037994-d49a-46c8-9bb7-11d80a74e253 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:59.647552 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ba037994-d49a-46c8-9bb7-11d80a74e253 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:59.648322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ba037994-d49a-46c8-9bb7-11d80a74e253 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:07:59.649196 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ba037994-d49a-46c8-9bb7-11d80a74e253 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:07:59.649818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ba037994-d49a-46c8-9bb7-11d80a74e253 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:07:59.853123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ba037994-d49a-46c8-9bb7-11d80a74e253 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:07:59.867991 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ba037994-d49a-46c8-9bb7-11d80a74e253 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1547 microversion: 2.1 time: 0.235986 Sep 16 08:07:59.869703 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 202/378] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:07:59 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1547 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:00.178651 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a2d80b05-cbb5-4f2a-bb35-97e5a2e84d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:00.179458 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a2d80b05-cbb5-4f2a-bb35-97e5a2e84d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:00.190574 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a2d80b05-cbb5-4f2a-bb35-97e5a2e84d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:00.191105 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a2d80b05-cbb5-4f2a-bb35-97e5a2e84d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:00.191548 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a2d80b05-cbb5-4f2a-bb35-97e5a2e84d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:00.195507 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a2d80b05-cbb5-4f2a-bb35-97e5a2e84d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:00.195985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a2d80b05-cbb5-4f2a-bb35-97e5a2e84d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:00.196668 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a2d80b05-cbb5-4f2a-bb35-97e5a2e84d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:00.368250 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-bde64d48-a2be-459d-883a-0a66a4ece7a0 req-00ab4abf-7e78-4bea-839e-aad7de8e46e1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6372a5c9-25ed-4593-861f-78a0f8cf03ce", "name": "network-vif-plugged", "status": "completed", "tag": "0587b75f-a06f-40a0-8e4d-3ac7308fa48a"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:00.378529 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-bde64d48-a2be-459d-883a-0a66a4ece7a0 req-00ab4abf-7e78-4bea-839e-aad7de8e46e1 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:00.379040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-bde64d48-a2be-459d-883a-0a66a4ece7a0 req-00ab4abf-7e78-4bea-839e-aad7de8e46e1 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:00.379839 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-bde64d48-a2be-459d-883a-0a66a4ece7a0 req-00ab4abf-7e78-4bea-839e-aad7de8e46e1 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:00.406350 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-bde64d48-a2be-459d-883a-0a66a4ece7a0 req-00ab4abf-7e78-4bea-839e-aad7de8e46e1 service nova] Creating event network-vif-plugged:0587b75f-a06f-40a0-8e4d-3ac7308fa48a for instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce on hv-cinder-74014 Sep 16 08:08:00.412082 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a2d80b05-cbb5-4f2a-bb35-97e5a2e84d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:00.413377 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-bde64d48-a2be-459d-883a-0a66a4ece7a0 req-00ab4abf-7e78-4bea-839e-aad7de8e46e1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.049317 Sep 16 08:08:00.415605 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 203/379] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:08:00 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:08:00.432912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a2d80b05-cbb5-4f2a-bb35-97e5a2e84d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.257601 Sep 16 08:08:00.435406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 177/380] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:00 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:00.482762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c4691a48-718a-45f1-8008-17643921988b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:00.485589 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c4691a48-718a-45f1-8008-17643921988b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:00.497501 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c4691a48-718a-45f1-8008-17643921988b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:00.498949 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c4691a48-718a-45f1-8008-17643921988b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:00.499651 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c4691a48-718a-45f1-8008-17643921988b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:00.500646 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c4691a48-718a-45f1-8008-17643921988b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:00.501226 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c4691a48-718a-45f1-8008-17643921988b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:00.501864 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c4691a48-718a-45f1-8008-17643921988b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:00.753074 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c4691a48-718a-45f1-8008-17643921988b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:00.774418 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c4691a48-718a-45f1-8008-17643921988b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.304182 Sep 16 08:08:00.779885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 204/381] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:00 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:01.341760 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-ServerRescueNegativeTestJSON-server-184187678", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "24df6cf0-63a8-4e5b-a9ad-1254d9c28362"}], "security_groups": [{"name": "tempest-securitygroup--867565784"}], "key_name": "tempest-keypair-1395195768", "user_data": "}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:01.457986 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ede03e3a-b5ba-4688-ae4a-ea49e156f04f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:01.458596 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ede03e3a-b5ba-4688-ae4a-ea49e156f04f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:01.466105 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ede03e3a-b5ba-4688-ae4a-ea49e156f04f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:01.470281 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ede03e3a-b5ba-4688-ae4a-ea49e156f04f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:01.470281 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ede03e3a-b5ba-4688-ae4a-ea49e156f04f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:01.470281 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ede03e3a-b5ba-4688-ae4a-ea49e156f04f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:01.476686 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ede03e3a-b5ba-4688-ae4a-ea49e156f04f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:01.477408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ede03e3a-b5ba-4688-ae4a-ea49e156f04f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:01.495156 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.network.neutron [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] validate_networks() for [('24df6cf0-63a8-4e5b-a9ad-1254d9c28362', None, None, None, None, None)] {{(pid=121047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:08:01.791633 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ede03e3a-b5ba-4688-ae4a-ea49e156f04f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:01.801781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ede03e3a-b5ba-4688-ae4a-ea49e156f04f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.348155 Sep 16 08:08:01.805240 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 205/382] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:01 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:01.817710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-09d91575-bf75-415d-b75f-aab6e128a035 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:01.818531 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-09d91575-bf75-415d-b75f-aab6e128a035 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:01.822595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=99,nova_api:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:01.840783 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-09d91575-bf75-415d-b75f-aab6e128a035 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:01.842523 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-09d91575-bf75-415d-b75f-aab6e128a035 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:01.843220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-09d91575-bf75-415d-b75f-aab6e128a035 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:01.845239 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-09d91575-bf75-415d-b75f-aab6e128a035 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:01.845933 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-09d91575-bf75-415d-b75f-aab6e128a035 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:01.846541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-09d91575-bf75-415d-b75f-aab6e128a035 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:01.872593 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:02.024422 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Flavor limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:08:02.025360 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Image limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:08:02.025846 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Flavor pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:08:02.027133 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Image pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:08:02.027603 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:08:02.036946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:02.037430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:02.037968 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:02.038967 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:02.039427 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:02.045421 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:02.069818 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Getting quotas for project f143f731c6cc4b38ba979827cd390f77. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:08:02.074425 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Getting quotas for user 5a85cff936184b5d94375fd103493950 and project f143f731c6cc4b38ba979827cd390f77. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:08:02.106022 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Going to run 1 instances... {{(pid=121047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:08:02.108972 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:08:02.136490 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-09d91575-bf75-415d-b75f-aab6e128a035 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:02.147161 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-09d91575-bf75-415d-b75f-aab6e128a035 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1366 microversion: 2.1 time: 0.340607 Sep 16 08:08:02.147827 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 206/383] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:01 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1366 bytes in 342 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:02.178810 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-40a03ee9-9562-4872-961d-ac41fa849574 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "263a4d0a-9657-4099-bf0b-8f0069b41ec7"}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:02.181795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-40a03ee9-9562-4872-961d-ac41fa849574 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:02.195439 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-40a03ee9-9562-4872-961d-ac41fa849574 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:02.196416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-40a03ee9-9562-4872-961d-ac41fa849574 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:02.198753 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-40a03ee9-9562-4872-961d-ac41fa849574 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:02.198753 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-40a03ee9-9562-4872-961d-ac41fa849574 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:02.199096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-40a03ee9-9562-4872-961d-ac41fa849574 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:02.199895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-40a03ee9-9562-4872-961d-ac41fa849574 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:02.278584 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2a0bdfa2-21eb-4c81-a18a-2c10811fb486 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 408 microversion: 2.1 time: 0.941054 Sep 16 08:08:02.290750 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 178/384] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:08:01 2022] POST /compute/v2.1/servers => generated 408 bytes in 954 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 08:08:02.304218 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-49a282cf-359d-465c-b85d-bd7d25f7da47 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:02.306514 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-49a282cf-359d-465c-b85d-bd7d25f7da47 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:02.443105 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-49a282cf-359d-465c-b85d-bd7d25f7da47 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:02.454128 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-49a282cf-359d-465c-b85d-bd7d25f7da47 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1245 microversion: 2.1 time: 0.161886 Sep 16 08:08:02.463452 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 179/385] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:02 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1245 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:02.839772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-cf90c5d8-17a5-44b0-ac88-cdb388b77f26 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:02.840398 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-cf90c5d8-17a5-44b0-ac88-cdb388b77f26 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:02.859119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cf90c5d8-17a5-44b0-ac88-cdb388b77f26 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:02.859720 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cf90c5d8-17a5-44b0-ac88-cdb388b77f26 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.011s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:02.860197 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cf90c5d8-17a5-44b0-ac88-cdb388b77f26 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:02.866664 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cf90c5d8-17a5-44b0-ac88-cdb388b77f26 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:02.873775 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cf90c5d8-17a5-44b0-ac88-cdb388b77f26 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:02.873775 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cf90c5d8-17a5-44b0-ac88-cdb388b77f26 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:03.171012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cf90c5d8-17a5-44b0-ac88-cdb388b77f26 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:03.186366 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-cf90c5d8-17a5-44b0-ac88-cdb388b77f26 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1721 microversion: 2.1 time: 0.350342 Sep 16 08:08:03.187358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 180/386] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:02 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1721 bytes in 352 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:08:03.206322 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ec739f56-2861-4830-89e8-f4719557a72e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:03.206984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ec739f56-2861-4830-89e8-f4719557a72e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:03.221119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec739f56-2861-4830-89e8-f4719557a72e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:03.221119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec739f56-2861-4830-89e8-f4719557a72e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:03.225610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec739f56-2861-4830-89e8-f4719557a72e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:03.226395 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec739f56-2861-4830-89e8-f4719557a72e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:03.227103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec739f56-2861-4830-89e8-f4719557a72e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:03.227739 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ec739f56-2861-4830-89e8-f4719557a72e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:03.409409 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ec739f56-2861-4830-89e8-f4719557a72e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:03.420058 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ec739f56-2861-4830-89e8-f4719557a72e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1556 microversion: 2.1 time: 0.229439 Sep 16 08:08:03.421029 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 181/387] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:03 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1556 bytes in 233 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:03.455124 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-133189ea-3da0-470c-9f7f-5e791e99f35c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:03.455735 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-133189ea-3da0-470c-9f7f-5e791e99f35c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:03.462319 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-133189ea-3da0-470c-9f7f-5e791e99f35c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:03.462771 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-133189ea-3da0-470c-9f7f-5e791e99f35c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:03.463507 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-133189ea-3da0-470c-9f7f-5e791e99f35c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:03.464317 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-133189ea-3da0-470c-9f7f-5e791e99f35c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:03.465099 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-133189ea-3da0-470c-9f7f-5e791e99f35c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:03.465694 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-133189ea-3da0-470c-9f7f-5e791e99f35c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:03.587796 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-133189ea-3da0-470c-9f7f-5e791e99f35c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.142669 Sep 16 08:08:03.588972 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 182/388] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Sep 16 08:08:03 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce/os-interface => generated 285 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:08:03.596394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-cb62decb-e1f7-44af-bd0f-c38ce3b80974 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:03.596967 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-cb62decb-e1f7-44af-bd0f-c38ce3b80974 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:03.730077 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cb62decb-e1f7-44af-bd0f-c38ce3b80974 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:03.742673 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-cb62decb-e1f7-44af-bd0f-c38ce3b80974 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1245 microversion: 2.1 time: 0.150764 Sep 16 08:08:03.744664 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 183/389] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:03 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1245 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:03.776091 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-40a03ee9-9562-4872-961d-ac41fa849574 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "POST /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.626630 Sep 16 08:08:03.776708 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 207/390] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:08:02 2022] POST /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments => generated 194 bytes in 1628 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:08:04.216038 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c548554a-5c25-407c-9957-a5ecdb5e6919 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:04.216744 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c548554a-5c25-407c-9957-a5ecdb5e6919 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:04.222933 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c548554a-5c25-407c-9957-a5ecdb5e6919 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:04.223541 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c548554a-5c25-407c-9957-a5ecdb5e6919 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:04.224063 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c548554a-5c25-407c-9957-a5ecdb5e6919 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:04.224838 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c548554a-5c25-407c-9957-a5ecdb5e6919 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:04.225371 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c548554a-5c25-407c-9957-a5ecdb5e6919 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:04.225928 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c548554a-5c25-407c-9957-a5ecdb5e6919 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:04.474143 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c548554a-5c25-407c-9957-a5ecdb5e6919 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:04.486714 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c548554a-5c25-407c-9957-a5ecdb5e6919 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1698 microversion: 2.1 time: 0.277502 Sep 16 08:08:04.487947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 184/391] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:04 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1698 bytes in 279 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:04.513276 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1067830c-f28e-43a9-818b-a41ab4392da3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:04.521507 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1067830c-f28e-43a9-818b-a41ab4392da3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:04.522002 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1067830c-f28e-43a9-818b-a41ab4392da3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:04.522447 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1067830c-f28e-43a9-818b-a41ab4392da3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:04.571393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1067830c-f28e-43a9-818b-a41ab4392da3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Going to try to start instance {{(pid=121046) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 08:08:04.774966 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a8a74ac7-ca47-45f2-811a-de838781b0d6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:04.775861 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1067830c-f28e-43a9-818b-a41ab4392da3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "POST /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/action" status: 202 len: 0 microversion: 2.1 time: 0.267546 Sep 16 08:08:04.776395 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a8a74ac7-ca47-45f2-811a-de838781b0d6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:04.776874 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 208/392] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:08:04 2022] POST /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/action => generated 0 bytes in 270 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:08:04.793460 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-120f99e1-da89-4f0c-afcc-46e9459ed4b5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:04.796974 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a8a74ac7-ca47-45f2-811a-de838781b0d6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:04.799251 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a8a74ac7-ca47-45f2-811a-de838781b0d6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:04.800134 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a8a74ac7-ca47-45f2-811a-de838781b0d6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:04.800432 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-120f99e1-da89-4f0c-afcc-46e9459ed4b5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:04.801911 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a8a74ac7-ca47-45f2-811a-de838781b0d6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:04.804279 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a8a74ac7-ca47-45f2-811a-de838781b0d6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:04.810365 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a8a74ac7-ca47-45f2-811a-de838781b0d6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:04.822195 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-120f99e1-da89-4f0c-afcc-46e9459ed4b5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:04.822805 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-120f99e1-da89-4f0c-afcc-46e9459ed4b5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:04.823359 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-120f99e1-da89-4f0c-afcc-46e9459ed4b5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:04.829039 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-120f99e1-da89-4f0c-afcc-46e9459ed4b5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:04.829674 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-120f99e1-da89-4f0c-afcc-46e9459ed4b5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:04.830360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-120f99e1-da89-4f0c-afcc-46e9459ed4b5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:05.015401 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a8a74ac7-ca47-45f2-811a-de838781b0d6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:05.043067 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a8a74ac7-ca47-45f2-811a-de838781b0d6 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1297 microversion: 2.1 time: 0.275919 Sep 16 08:08:05.047089 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 185/393] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:04 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1297 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:08:05.097238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-120f99e1-da89-4f0c-afcc-46e9459ed4b5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:05.110580 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-120f99e1-da89-4f0c-afcc-46e9459ed4b5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1707 microversion: 2.1 time: 0.328972 Sep 16 08:08:05.112947 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 209/394] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:04 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1707 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:08:05.447075 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-eaf8ed09-c380-478d-b4ce-cf302d9a15b6 req-74fd99f5-4d42-4094-97ee-41359156cd9b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6372a5c9-25ed-4593-861f-78a0f8cf03ce", "tag": "0587b75f-a06f-40a0-8e4d-3ac7308fa48a"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:05.465303 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-eaf8ed09-c380-478d-b4ce-cf302d9a15b6 req-74fd99f5-4d42-4094-97ee-41359156cd9b service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:05.467871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-eaf8ed09-c380-478d-b4ce-cf302d9a15b6 req-74fd99f5-4d42-4094-97ee-41359156cd9b service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:05.468723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-eaf8ed09-c380-478d-b4ce-cf302d9a15b6 req-74fd99f5-4d42-4094-97ee-41359156cd9b service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:05.483908 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-eaf8ed09-c380-478d-b4ce-cf302d9a15b6 req-74fd99f5-4d42-4094-97ee-41359156cd9b service nova] Creating event network-changed:0587b75f-a06f-40a0-8e4d-3ac7308fa48a for instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce on hv-cinder-74014 Sep 16 08:08:05.492362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-eaf8ed09-c380-478d-b4ce-cf302d9a15b6 req-74fd99f5-4d42-4094-97ee-41359156cd9b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049289 Sep 16 08:08:05.493674 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 186/395] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:08:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:08:06.071269 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-07de5c00-2d13-43be-aa92-4f9fb1bdb2bf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:06.073211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-07de5c00-2d13-43be-aa92-4f9fb1bdb2bf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:06.088700 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-07de5c00-2d13-43be-aa92-4f9fb1bdb2bf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:06.089623 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-07de5c00-2d13-43be-aa92-4f9fb1bdb2bf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:06.091096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-07de5c00-2d13-43be-aa92-4f9fb1bdb2bf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:06.091981 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-07de5c00-2d13-43be-aa92-4f9fb1bdb2bf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:06.092552 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-07de5c00-2d13-43be-aa92-4f9fb1bdb2bf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:06.094023 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-07de5c00-2d13-43be-aa92-4f9fb1bdb2bf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:06.142467 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-039daa18-8419-4d8f-95a3-960e16614d4e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:06.144182 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-039daa18-8419-4d8f-95a3-960e16614d4e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:06.171761 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-039daa18-8419-4d8f-95a3-960e16614d4e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:06.172870 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-039daa18-8419-4d8f-95a3-960e16614d4e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:06.176651 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-039daa18-8419-4d8f-95a3-960e16614d4e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:06.183033 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-039daa18-8419-4d8f-95a3-960e16614d4e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:06.184589 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-039daa18-8419-4d8f-95a3-960e16614d4e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:06.187646 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-039daa18-8419-4d8f-95a3-960e16614d4e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:06.504368 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-039daa18-8419-4d8f-95a3-960e16614d4e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:06.537600 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-039daa18-8419-4d8f-95a3-960e16614d4e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1707 microversion: 2.1 time: 0.402882 Sep 16 08:08:06.541294 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 187/396] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:06 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1707 bytes in 409 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:06.619880 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-07de5c00-2d13-43be-aa92-4f9fb1bdb2bf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:06.635775 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-07de5c00-2d13-43be-aa92-4f9fb1bdb2bf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1315 microversion: 2.1 time: 0.568775 Sep 16 08:08:06.652329 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 210/397] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:06 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1315 bytes in 587 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:07.570645 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-8685ec93-f2e0-4095-b752-a450f34e8351 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:07.571477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-8685ec93-f2e0-4095-b752-a450f34e8351 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:07.578486 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8685ec93-f2e0-4095-b752-a450f34e8351 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:07.580285 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8685ec93-f2e0-4095-b752-a450f34e8351 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:07.581201 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8685ec93-f2e0-4095-b752-a450f34e8351 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:07.582725 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8685ec93-f2e0-4095-b752-a450f34e8351 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:07.583407 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8685ec93-f2e0-4095-b752-a450f34e8351 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:07.584143 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8685ec93-f2e0-4095-b752-a450f34e8351 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:07.607998 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=100 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:07.661874 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5461c037-0a22-423f-ba7b-972357593284 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:07.663105 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5461c037-0a22-423f-ba7b-972357593284 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:07.677907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5461c037-0a22-423f-ba7b-972357593284 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:07.679199 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5461c037-0a22-423f-ba7b-972357593284 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:07.681185 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5461c037-0a22-423f-ba7b-972357593284 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:07.683050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5461c037-0a22-423f-ba7b-972357593284 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:07.684170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5461c037-0a22-423f-ba7b-972357593284 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:07.685983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5461c037-0a22-423f-ba7b-972357593284 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:07.811470 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-8685ec93-f2e0-4095-b752-a450f34e8351 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:07.818640 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=4 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:07.821463 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-8685ec93-f2e0-4095-b752-a450f34e8351 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1707 microversion: 2.1 time: 0.261244 Sep 16 08:08:07.822124 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 188/398] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:07 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1707 bytes in 263 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:07.961844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5461c037-0a22-423f-ba7b-972357593284 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:07.980823 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5461c037-0a22-423f-ba7b-972357593284 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1370 microversion: 2.1 time: 0.322474 Sep 16 08:08:07.990765 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 211/399] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:07 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1370 bytes in 332 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:08:08.848155 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1712772d-7e54-469c-9e66-dd61ed835a39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:08.848765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1712772d-7e54-469c-9e66-dd61ed835a39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:08.855660 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1712772d-7e54-469c-9e66-dd61ed835a39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:08.856148 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1712772d-7e54-469c-9e66-dd61ed835a39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:08.856584 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1712772d-7e54-469c-9e66-dd61ed835a39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:08.857278 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1712772d-7e54-469c-9e66-dd61ed835a39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:08.857918 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1712772d-7e54-469c-9e66-dd61ed835a39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:08.858344 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1712772d-7e54-469c-9e66-dd61ed835a39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:09.008618 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-074d1ced-c70a-44aa-bf11-1d87d654560a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:09.009246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-074d1ced-c70a-44aa-bf11-1d87d654560a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:09.027380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-074d1ced-c70a-44aa-bf11-1d87d654560a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:09.027938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-074d1ced-c70a-44aa-bf11-1d87d654560a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:09.031879 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-074d1ced-c70a-44aa-bf11-1d87d654560a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:09.033586 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-074d1ced-c70a-44aa-bf11-1d87d654560a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:09.034204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-074d1ced-c70a-44aa-bf11-1d87d654560a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:09.036647 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-074d1ced-c70a-44aa-bf11-1d87d654560a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:09.204313 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1712772d-7e54-469c-9e66-dd61ed835a39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:09.213317 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1712772d-7e54-469c-9e66-dd61ed835a39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1711 microversion: 2.1 time: 0.369454 Sep 16 08:08:09.219311 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 189/400] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:08 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1711 bytes in 376 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:09.252838 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-074d1ced-c70a-44aa-bf11-1d87d654560a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:09.267139 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-074d1ced-c70a-44aa-bf11-1d87d654560a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1370 microversion: 2.1 time: 0.259796 Sep 16 08:08:09.267139 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 212/401] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:09 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1370 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:09.555649 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-163877c2-8bfe-4227-8a52-88d39abd8d7a req-369bf0dc-afca-4870-bef3-c99bb4571517 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e79005e-be5d-4326-aa8d-28bdef7f1a3b", "tag": "e41ec44c-439a-45a5-9e2e-66947ff6004f"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:09.568537 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-163877c2-8bfe-4227-8a52-88d39abd8d7a req-369bf0dc-afca-4870-bef3-c99bb4571517 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:09.569200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-163877c2-8bfe-4227-8a52-88d39abd8d7a req-369bf0dc-afca-4870-bef3-c99bb4571517 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:09.569797 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-163877c2-8bfe-4227-8a52-88d39abd8d7a req-369bf0dc-afca-4870-bef3-c99bb4571517 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:09.581666 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-163877c2-8bfe-4227-8a52-88d39abd8d7a req-369bf0dc-afca-4870-bef3-c99bb4571517 service nova] Creating event network-changed:e41ec44c-439a-45a5-9e2e-66947ff6004f for instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b on hv-cinder-74014 Sep 16 08:08:09.591567 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-163877c2-8bfe-4227-8a52-88d39abd8d7a req-369bf0dc-afca-4870-bef3-c99bb4571517 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.039310 Sep 16 08:08:09.592430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 190/402] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:08:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:08:10.287247 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8fcbb219-50af-4818-abf7-14ba3cc730c9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:10.288449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8fcbb219-50af-4818-abf7-14ba3cc730c9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:10.300629 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fcbb219-50af-4818-abf7-14ba3cc730c9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:10.307668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fcbb219-50af-4818-abf7-14ba3cc730c9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:10.307668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fcbb219-50af-4818-abf7-14ba3cc730c9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:10.307668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fcbb219-50af-4818-abf7-14ba3cc730c9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:10.307668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fcbb219-50af-4818-abf7-14ba3cc730c9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:10.308364 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fcbb219-50af-4818-abf7-14ba3cc730c9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:10.491743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8fcbb219-50af-4818-abf7-14ba3cc730c9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:10.500376 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8fcbb219-50af-4818-abf7-14ba3cc730c9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1370 microversion: 2.1 time: 0.217373 Sep 16 08:08:10.500915 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 213/403] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:10 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1370 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:11.525684 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-99f54bfc-18e7-4075-911f-1eae2d897bb9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:11.527211 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-99f54bfc-18e7-4075-911f-1eae2d897bb9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:11.536870 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-99f54bfc-18e7-4075-911f-1eae2d897bb9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:11.537783 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-99f54bfc-18e7-4075-911f-1eae2d897bb9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:11.538546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-99f54bfc-18e7-4075-911f-1eae2d897bb9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:11.539609 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-99f54bfc-18e7-4075-911f-1eae2d897bb9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:11.540270 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-99f54bfc-18e7-4075-911f-1eae2d897bb9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:11.540922 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-99f54bfc-18e7-4075-911f-1eae2d897bb9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:11.743752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-99f54bfc-18e7-4075-911f-1eae2d897bb9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:11.753032 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-99f54bfc-18e7-4075-911f-1eae2d897bb9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1370 microversion: 2.1 time: 0.231752 Sep 16 08:08:11.753857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 191/404] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:11 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1370 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:12.536513 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b86d3633-7ec1-4134-8f15-90ec86cc19a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Action: 'create', calling method: .version_select at 0x7f9d06bd5d30>, body: {"keypair": {"name": "tempest-TestVolumeBootPattern-1882303610", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPGWdHZFzLPJ/B9WDgPn9UWrS4dp1EuwRnOVWCeALPx7wBvTpGdokBEoUs9PCBM/PsXUbc4L1AfbfrQ6m3c753qnGFYdt4oHAOokttuNo2zuG1fLaEe5kn+jULI7WWovQg=="}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:12.552290 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-b86d3633-7ec1-4134-8f15-90ec86cc19a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Getting quotas for project 794ad972bfa844538f6f71d62e7bd163. Resources: {'key_pairs'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:08:12.556128 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-b86d3633-7ec1-4134-8f15-90ec86cc19a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Getting quotas for user afbb1d9c9bb34fbd8bfc78710c86d1f5 and project 794ad972bfa844538f6f71d62e7bd163. Resources: {'key_pairs'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:08:12.670467 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b86d3633-7ec1-4134-8f15-90ec86cc19a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 400 microversion: 2.1 time: 0.308486 Sep 16 08:08:12.671115 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 214/405] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Sep 16 08:08:12 2022] POST /compute/v2.1/os-keypairs => generated 400 bytes in 310 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:08:12.778937 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-92364d22-7dd6-4939-b839-d5d02a56ece3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:12.779555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-92364d22-7dd6-4939-b839-d5d02a56ece3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:12.782544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=4 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:12.788578 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-92364d22-7dd6-4939-b839-d5d02a56ece3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:12.789703 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-92364d22-7dd6-4939-b839-d5d02a56ece3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:12.790152 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-92364d22-7dd6-4939-b839-d5d02a56ece3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:12.790903 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-92364d22-7dd6-4939-b839-d5d02a56ece3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:12.791367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-92364d22-7dd6-4939-b839-d5d02a56ece3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:12.791819 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-92364d22-7dd6-4939-b839-d5d02a56ece3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:12.949494 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-92364d22-7dd6-4939-b839-d5d02a56ece3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:12.957573 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-92364d22-7dd6-4939-b839-d5d02a56ece3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1370 microversion: 2.1 time: 0.182328 Sep 16 08:08:12.959424 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 192/406] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:12 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1370 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:13.769193 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-929dbc42-9e3f-4584-a04a-38fbfb0961c8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:13.769871 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-929dbc42-9e3f-4584-a04a-38fbfb0961c8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:13.777296 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-929dbc42-9e3f-4584-a04a-38fbfb0961c8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:13.777797 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-929dbc42-9e3f-4584-a04a-38fbfb0961c8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:13.778466 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-929dbc42-9e3f-4584-a04a-38fbfb0961c8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:13.779450 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-929dbc42-9e3f-4584-a04a-38fbfb0961c8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:13.779915 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-929dbc42-9e3f-4584-a04a-38fbfb0961c8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:13.780352 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-929dbc42-9e3f-4584-a04a-38fbfb0961c8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:13.933205 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-929dbc42-9e3f-4584-a04a-38fbfb0961c8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:13.941753 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-929dbc42-9e3f-4584-a04a-38fbfb0961c8 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1593 microversion: 2.1 time: 0.177178 Sep 16 08:08:13.942330 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 215/407] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:13 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1593 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:13.982185 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-bb8b6d88-c6c0-4236-87d9-0931358904da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:13.982881 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-bb8b6d88-c6c0-4236-87d9-0931358904da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:13.984753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=10 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:13.990452 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb8b6d88-c6c0-4236-87d9-0931358904da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:13.990977 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb8b6d88-c6c0-4236-87d9-0931358904da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:13.991422 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb8b6d88-c6c0-4236-87d9-0931358904da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:13.992123 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb8b6d88-c6c0-4236-87d9-0931358904da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:13.992589 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb8b6d88-c6c0-4236-87d9-0931358904da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:13.993018 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb8b6d88-c6c0-4236-87d9-0931358904da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:14.173341 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-bb8b6d88-c6c0-4236-87d9-0931358904da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:14.181175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-bb8b6d88-c6c0-4236-87d9-0931358904da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1370 microversion: 2.1 time: 0.204618 Sep 16 08:08:14.181756 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 193/408] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:13 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1370 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:15.204695 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2526b9e2-60f6-488a-8a16-99d3efb42987 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:15.205315 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2526b9e2-60f6-488a-8a16-99d3efb42987 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:15.216920 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2526b9e2-60f6-488a-8a16-99d3efb42987 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:15.217455 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2526b9e2-60f6-488a-8a16-99d3efb42987 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:15.217898 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2526b9e2-60f6-488a-8a16-99d3efb42987 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:15.218609 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2526b9e2-60f6-488a-8a16-99d3efb42987 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:15.219298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2526b9e2-60f6-488a-8a16-99d3efb42987 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:15.220098 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2526b9e2-60f6-488a-8a16-99d3efb42987 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:15.755559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2526b9e2-60f6-488a-8a16-99d3efb42987 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:15.763341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2526b9e2-60f6-488a-8a16-99d3efb42987 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1370 microversion: 2.1 time: 0.562801 Sep 16 08:08:15.763950 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 216/409] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:15 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1370 bytes in 564 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:16.787663 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-25edc467-ff1b-4b7d-abad-4fcb61bb38e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:16.788959 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-25edc467-ff1b-4b7d-abad-4fcb61bb38e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:16.792394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=97,nova_api:INSERT=3 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:16.799001 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-25edc467-ff1b-4b7d-abad-4fcb61bb38e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:16.799684 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-25edc467-ff1b-4b7d-abad-4fcb61bb38e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:16.800296 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-25edc467-ff1b-4b7d-abad-4fcb61bb38e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:16.801722 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-25edc467-ff1b-4b7d-abad-4fcb61bb38e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:16.802345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-25edc467-ff1b-4b7d-abad-4fcb61bb38e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:16.802812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-25edc467-ff1b-4b7d-abad-4fcb61bb38e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:16.973811 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-25edc467-ff1b-4b7d-abad-4fcb61bb38e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:16.982552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-25edc467-ff1b-4b7d-abad-4fcb61bb38e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1370 microversion: 2.1 time: 0.200087 Sep 16 08:08:16.983759 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 194/410] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:16 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1370 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:17.216937 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-b04a97f9-944f-4403-b14a-a610a2bf5695 req-67e7d601-f197-4aa6-8e48-751010ebdff1 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998c37d2-18ab-459f-a9d6-bf19c51fb695", "tag": "800c16c0-6c80-47ad-8a9f-a60246ce9a01"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:17.232091 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b04a97f9-944f-4403-b14a-a610a2bf5695 req-67e7d601-f197-4aa6-8e48-751010ebdff1 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:17.232656 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b04a97f9-944f-4403-b14a-a610a2bf5695 req-67e7d601-f197-4aa6-8e48-751010ebdff1 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:17.233181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b04a97f9-944f-4403-b14a-a610a2bf5695 req-67e7d601-f197-4aa6-8e48-751010ebdff1 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:17.244773 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-b04a97f9-944f-4403-b14a-a610a2bf5695 req-67e7d601-f197-4aa6-8e48-751010ebdff1 service nova] Creating event network-changed:800c16c0-6c80-47ad-8a9f-a60246ce9a01 for instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 on hv-cinder-74014 Sep 16 08:08:17.250219 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-b04a97f9-944f-4403-b14a-a610a2bf5695 req-67e7d601-f197-4aa6-8e48-751010ebdff1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.041923 Sep 16 08:08:17.251228 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 217/411] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:08:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:08:18.006453 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-534c41c6-5646-4ddb-a313-28860a1f4490 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:18.007111 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-534c41c6-5646-4ddb-a313-28860a1f4490 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:18.014423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-534c41c6-5646-4ddb-a313-28860a1f4490 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:18.015050 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-534c41c6-5646-4ddb-a313-28860a1f4490 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:18.015502 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-534c41c6-5646-4ddb-a313-28860a1f4490 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:18.016208 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-534c41c6-5646-4ddb-a313-28860a1f4490 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:18.016875 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-534c41c6-5646-4ddb-a313-28860a1f4490 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:18.017338 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-534c41c6-5646-4ddb-a313-28860a1f4490 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:18.174257 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-534c41c6-5646-4ddb-a313-28860a1f4490 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:18.182879 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-534c41c6-5646-4ddb-a313-28860a1f4490 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1370 microversion: 2.1 time: 0.180958 Sep 16 08:08:18.183465 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 195/412] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:18 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1370 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:08:18.592082 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-25036006-0c4c-4e98-a715-7f0b193aeb7d req-56f99255-ac27-43d5-9acc-d6c5a832b05d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e79005e-be5d-4326-aa8d-28bdef7f1a3b", "name": "network-vif-plugged", "status": "completed", "tag": "e41ec44c-439a-45a5-9e2e-66947ff6004f"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:18.606502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-25036006-0c4c-4e98-a715-7f0b193aeb7d req-56f99255-ac27-43d5-9acc-d6c5a832b05d service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:18.611227 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-25036006-0c4c-4e98-a715-7f0b193aeb7d req-56f99255-ac27-43d5-9acc-d6c5a832b05d service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:18.611227 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-25036006-0c4c-4e98-a715-7f0b193aeb7d req-56f99255-ac27-43d5-9acc-d6c5a832b05d service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:18.620141 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-25036006-0c4c-4e98-a715-7f0b193aeb7d req-56f99255-ac27-43d5-9acc-d6c5a832b05d service nova] Creating event network-vif-plugged:e41ec44c-439a-45a5-9e2e-66947ff6004f for instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b on hv-cinder-74014 Sep 16 08:08:18.625676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-25036006-0c4c-4e98-a715-7f0b193aeb7d req-56f99255-ac27-43d5-9acc-d6c5a832b05d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038882 Sep 16 08:08:18.626277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 218/413] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:08:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:08:19.219185 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-95027530-096c-4b3c-819c-66bbce33c81c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:19.219799 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-95027530-096c-4b3c-819c-66bbce33c81c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:19.227107 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95027530-096c-4b3c-819c-66bbce33c81c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:19.227604 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95027530-096c-4b3c-819c-66bbce33c81c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:19.228155 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95027530-096c-4b3c-819c-66bbce33c81c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:19.228911 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95027530-096c-4b3c-819c-66bbce33c81c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:19.229506 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95027530-096c-4b3c-819c-66bbce33c81c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:19.229942 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95027530-096c-4b3c-819c-66bbce33c81c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:19.365777 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-95027530-096c-4b3c-819c-66bbce33c81c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:19.374065 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-95027530-096c-4b3c-819c-66bbce33c81c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1370 microversion: 2.1 time: 0.158899 Sep 16 08:08:19.374647 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 196/414] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:19 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:20.021477 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b2d2e84b-41a6-4690-8c01-e33be112b347 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Action: 'action', calling method: >, body: {"addSecurityGroup": {"name": "tempest-secgroup-smoke-646625020"}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:20.022096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b2d2e84b-41a6-4690-8c01-e33be112b347 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:20.028700 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b2d2e84b-41a6-4690-8c01-e33be112b347 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:20.029177 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b2d2e84b-41a6-4690-8c01-e33be112b347 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:20.029609 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b2d2e84b-41a6-4690-8c01-e33be112b347 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:20.030287 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b2d2e84b-41a6-4690-8c01-e33be112b347 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:20.030763 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b2d2e84b-41a6-4690-8c01-e33be112b347 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:20.031442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b2d2e84b-41a6-4690-8c01-e33be112b347 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:20.160465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.network.security_group_api [None req-b2d2e84b-41a6-4690-8c01-e33be112b347 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Adding security group 8c083c54-7d89-4592-bda5-0577f206bf4b to port 800c16c0-6c80-47ad-8a9f-a60246ce9a01 Sep 16 08:08:20.398015 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c5562b0c-445b-4045-89c2-d24824b7f223 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:20.398584 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c5562b0c-445b-4045-89c2-d24824b7f223 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:20.405512 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c5562b0c-445b-4045-89c2-d24824b7f223 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:20.406452 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c5562b0c-445b-4045-89c2-d24824b7f223 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:20.406935 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c5562b0c-445b-4045-89c2-d24824b7f223 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:20.407757 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c5562b0c-445b-4045-89c2-d24824b7f223 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:20.408186 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c5562b0c-445b-4045-89c2-d24824b7f223 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:20.408791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c5562b0c-445b-4045-89c2-d24824b7f223 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:20.545090 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c5562b0c-445b-4045-89c2-d24824b7f223 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:20.552716 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c5562b0c-445b-4045-89c2-d24824b7f223 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1370 microversion: 2.1 time: 0.159186 Sep 16 08:08:20.553279 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 197/415] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:20 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1370 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:20.603719 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b2d2e84b-41a6-4690-8c01-e33be112b347 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "POST /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/action" status: 202 len: 0 microversion: 2.1 time: 0.586500 Sep 16 08:08:20.604600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 219/416] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:08:20 2022] POST /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/action => generated 0 bytes in 588 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:08:20.612785 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-026d9461-7bf7-4f1e-8cf0-1f7f1cf6d4fb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:20.613419 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-026d9461-7bf7-4f1e-8cf0-1f7f1cf6d4fb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:20.619390 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-026d9461-7bf7-4f1e-8cf0-1f7f1cf6d4fb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:20.620964 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-026d9461-7bf7-4f1e-8cf0-1f7f1cf6d4fb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:20.620964 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-026d9461-7bf7-4f1e-8cf0-1f7f1cf6d4fb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:20.621150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-026d9461-7bf7-4f1e-8cf0-1f7f1cf6d4fb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:20.621445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-026d9461-7bf7-4f1e-8cf0-1f7f1cf6d4fb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:20.621868 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-026d9461-7bf7-4f1e-8cf0-1f7f1cf6d4fb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:20.629290 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-f0cb2ef6-2b85-4039-b0d1-4f4d0738740a req-a4c1c4e3-9fbe-4fe6-ba8b-d9c673017b1c service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998c37d2-18ab-459f-a9d6-bf19c51fb695", "tag": "800c16c0-6c80-47ad-8a9f-a60246ce9a01"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:20.639748 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-f0cb2ef6-2b85-4039-b0d1-4f4d0738740a req-a4c1c4e3-9fbe-4fe6-ba8b-d9c673017b1c service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:20.640503 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-f0cb2ef6-2b85-4039-b0d1-4f4d0738740a req-a4c1c4e3-9fbe-4fe6-ba8b-d9c673017b1c service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:20.641018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-f0cb2ef6-2b85-4039-b0d1-4f4d0738740a req-a4c1c4e3-9fbe-4fe6-ba8b-d9c673017b1c service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:20.653472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-f0cb2ef6-2b85-4039-b0d1-4f4d0738740a req-a4c1c4e3-9fbe-4fe6-ba8b-d9c673017b1c service nova] Creating event network-changed:800c16c0-6c80-47ad-8a9f-a60246ce9a01 for instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 on hv-cinder-74014 Sep 16 08:08:20.660004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-f0cb2ef6-2b85-4039-b0d1-4f4d0738740a req-a4c1c4e3-9fbe-4fe6-ba8b-d9c673017b1c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034106 Sep 16 08:08:20.660668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 220/417] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:08:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:08:20.770547 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-026d9461-7bf7-4f1e-8cf0-1f7f1cf6d4fb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:20.779651 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-026d9461-7bf7-4f1e-8cf0-1f7f1cf6d4fb tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1758 microversion: 2.1 time: 0.170833 Sep 16 08:08:20.780236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 198/418] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:20 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:21.576189 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3fea745e-2473-4ce6-ba2a-9ca129f512e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:21.576825 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3fea745e-2473-4ce6-ba2a-9ca129f512e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:21.583065 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3fea745e-2473-4ce6-ba2a-9ca129f512e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:21.583549 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3fea745e-2473-4ce6-ba2a-9ca129f512e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:21.584017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3fea745e-2473-4ce6-ba2a-9ca129f512e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:21.584710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3fea745e-2473-4ce6-ba2a-9ca129f512e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:21.585245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3fea745e-2473-4ce6-ba2a-9ca129f512e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:21.585674 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3fea745e-2473-4ce6-ba2a-9ca129f512e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:21.717837 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3fea745e-2473-4ce6-ba2a-9ca129f512e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:21.727652 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3fea745e-2473-4ce6-ba2a-9ca129f512e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1563 microversion: 2.1 time: 0.156288 Sep 16 08:08:21.728966 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 221/419] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:21 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1563 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:21.755205 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-86d091a6-b776-4d69-893c-b7c8afca91ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:21.755935 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-86d091a6-b776-4d69-893c-b7c8afca91ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:21.770112 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86d091a6-b776-4d69-893c-b7c8afca91ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:21.771359 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86d091a6-b776-4d69-893c-b7c8afca91ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:21.782861 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86d091a6-b776-4d69-893c-b7c8afca91ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:21.782861 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86d091a6-b776-4d69-893c-b7c8afca91ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:21.782861 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86d091a6-b776-4d69-893c-b7c8afca91ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:21.782861 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86d091a6-b776-4d69-893c-b7c8afca91ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:21.900190 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-86d091a6-b776-4d69-893c-b7c8afca91ee tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.150101 Sep 16 08:08:21.901698 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 199/420] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Sep 16 08:08:21 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-interface => generated 284 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:08:23.316478 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-b822e73b-48d7-445c-843a-10595d1be4f7 req-dc0c7da8-16ab-439f-9518-044fd4086e8b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e79005e-be5d-4326-aa8d-28bdef7f1a3b", "tag": "e41ec44c-439a-45a5-9e2e-66947ff6004f"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:23.321559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=4 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:23.327349 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b822e73b-48d7-445c-843a-10595d1be4f7 req-dc0c7da8-16ab-439f-9518-044fd4086e8b service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:23.328022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b822e73b-48d7-445c-843a-10595d1be4f7 req-dc0c7da8-16ab-439f-9518-044fd4086e8b service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:23.328458 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b822e73b-48d7-445c-843a-10595d1be4f7 req-dc0c7da8-16ab-439f-9518-044fd4086e8b service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:23.339896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-b822e73b-48d7-445c-843a-10595d1be4f7 req-dc0c7da8-16ab-439f-9518-044fd4086e8b service nova] Creating event network-changed:e41ec44c-439a-45a5-9e2e-66947ff6004f for instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b on hv-cinder-74014 Sep 16 08:08:23.344821 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-b822e73b-48d7-445c-843a-10595d1be4f7 req-dc0c7da8-16ab-439f-9518-044fd4086e8b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032171 Sep 16 08:08:23.345486 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 222/421] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:08:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:08:37.290133 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=11 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:37.290967 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=63 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:37.294954 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5ac21f70-7d6c-4e81-8a12-8b005c90222c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:37.295480 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5ac21f70-7d6c-4e81-8a12-8b005c90222c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:37.301242 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5ac21f70-7d6c-4e81-8a12-8b005c90222c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:37.302366 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5ac21f70-7d6c-4e81-8a12-8b005c90222c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:37.302846 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5ac21f70-7d6c-4e81-8a12-8b005c90222c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:37.303556 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5ac21f70-7d6c-4e81-8a12-8b005c90222c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:37.304010 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5ac21f70-7d6c-4e81-8a12-8b005c90222c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:37.308430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5ac21f70-7d6c-4e81-8a12-8b005c90222c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:37.327072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5ac21f70-7d6c-4e81-8a12-8b005c90222c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/ips" status: 200 len: 152 microversion: 2.20 time: 0.038307 Sep 16 08:08:37.327633 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 200/422] 10.222.0.59 () {60 vars in 1289 bytes} [Fri Sep 16 08:08:37 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/ips => generated 152 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 08:08:39.499786 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=42,nova_api:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:39.500546 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=84,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:39.504849 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-18740219", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1882303610", "security_groups": [{"name": "tempest-secgroup-smoke-2047951653"}], "block_device_mapping_v2": [{"uuid": "0759dfca-a75d-482d-989d-897b8593a212", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3183744-0e74-401e-ac7d-6d88c22643af"}]}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:39.620498 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.network.neutron [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] validate_networks() for [('c3183744-0e74-401e-ac7d-6d88c22643af', None, None, None, None, None)] {{(pid=121046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:08:39.992970 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Flavor limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:08:39.993392 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Image limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:08:39.993863 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Flavor pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:08:39.994275 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Image pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:08:39.994703 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:08:40.003382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:40.003863 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:40.004356 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:40.005081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:40.005578 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:40.006009 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:40.022593 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Getting quotas for project 794ad972bfa844538f6f71d62e7bd163. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:08:40.026508 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Getting quotas for user afbb1d9c9bb34fbd8bfc78710c86d1f5 and project 794ad972bfa844538f6f71d62e7bd163. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:08:40.082521 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Going to run 1 instances... {{(pid=121046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:08:40.084866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0759dfca-a75d-482d-989d-897b8593a212',volume_size=None,volume_type=None)] {{(pid=121046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:08:40.152871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-8a8432c8-4e4b-4158-8e4b-4b358b1ddcfb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:40.153539 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-8a8432c8-4e4b-4158-8e4b-4b358b1ddcfb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:40.161371 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8a8432c8-4e4b-4158-8e4b-4b358b1ddcfb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:40.165521 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8a8432c8-4e4b-4158-8e4b-4b358b1ddcfb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:40.165521 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8a8432c8-4e4b-4158-8e4b-4b358b1ddcfb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:40.165521 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8a8432c8-4e4b-4158-8e4b-4b358b1ddcfb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:40.165521 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8a8432c8-4e4b-4158-8e4b-4b358b1ddcfb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:40.165906 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8a8432c8-4e4b-4158-8e4b-4b358b1ddcfb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:40.196645 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-8a8432c8-4e4b-4158-8e4b-4b358b1ddcfb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lazy-loading 'flavor' on Instance uuid 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:08:40.506657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-932decd2-3ff7-40a7-918d-116c0e229999 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.008387 Sep 16 08:08:40.507643 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 223/423] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:08:39 2022] POST /compute/v2.1/servers => generated 406 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:08:40.525769 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-04b206d5-d13b-4b0b-ad20-3415c7b9a847 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:40.526420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-04b206d5-d13b-4b0b-ad20-3415c7b9a847 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:40.585814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-04b206d5-d13b-4b0b-ad20-3415c7b9a847 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:40.594392 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-04b206d5-d13b-4b0b-ad20-3415c7b9a847 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1093 microversion: 2.1 time: 0.072597 Sep 16 08:08:40.595534 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 224/424] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:40 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1093 bytes in 80 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:40.769508 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-8a8432c8-4e4b-4158-8e4b-4b358b1ddcfb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "POST /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/action" status: 202 len: 0 microversion: 2.20 time: 0.622232 Sep 16 08:08:40.770097 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 201/425] 10.222.0.59 () {62 vars in 1319 bytes} [Fri Sep 16 08:08:40 2022] POST /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/action => generated 0 bytes in 624 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 08:08:40.778411 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8ebe0e54-0951-48d3-a017-a4754a637866 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:40.779136 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8ebe0e54-0951-48d3-a017-a4754a637866 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:40.786207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ebe0e54-0951-48d3-a017-a4754a637866 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:40.788943 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ebe0e54-0951-48d3-a017-a4754a637866 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:40.788943 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ebe0e54-0951-48d3-a017-a4754a637866 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:40.788943 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ebe0e54-0951-48d3-a017-a4754a637866 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:40.790247 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ebe0e54-0951-48d3-a017-a4754a637866 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:40.790711 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ebe0e54-0951-48d3-a017-a4754a637866 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:40.925730 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8ebe0e54-0951-48d3-a017-a4754a637866 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:40.937565 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8ebe0e54-0951-48d3-a017-a4754a637866 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:40.939135 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8ebe0e54-0951-48d3-a017-a4754a637866 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:40.940349 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8ebe0e54-0951-48d3-a017-a4754a637866 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.165899 Sep 16 08:08:40.941058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 225/426] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:40 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:41.618331 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-298e0456-3a11-4451-8085-5ca25b463664 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:41.619067 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-298e0456-3a11-4451-8085-5ca25b463664 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:41.626225 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e0456-3a11-4451-8085-5ca25b463664 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:41.626739 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e0456-3a11-4451-8085-5ca25b463664 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:41.627204 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e0456-3a11-4451-8085-5ca25b463664 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:41.627922 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e0456-3a11-4451-8085-5ca25b463664 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:41.628399 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e0456-3a11-4451-8085-5ca25b463664 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:41.628821 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-298e0456-3a11-4451-8085-5ca25b463664 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:41.695937 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-298e0456-3a11-4451-8085-5ca25b463664 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:41.703717 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-298e0456-3a11-4451-8085-5ca25b463664 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1143 microversion: 2.1 time: 0.090103 Sep 16 08:08:41.704277 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 202/427] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:41 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1143 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:41.985719 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2c38313b-1dca-4d81-a5e7-f8d8ebefa0fe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:41.986973 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2c38313b-1dca-4d81-a5e7-f8d8ebefa0fe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:41.993986 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2c38313b-1dca-4d81-a5e7-f8d8ebefa0fe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:41.995860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2c38313b-1dca-4d81-a5e7-f8d8ebefa0fe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:41.996260 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2c38313b-1dca-4d81-a5e7-f8d8ebefa0fe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:41.997017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2c38313b-1dca-4d81-a5e7-f8d8ebefa0fe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:41.997483 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2c38313b-1dca-4d81-a5e7-f8d8ebefa0fe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:41.998238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2c38313b-1dca-4d81-a5e7-f8d8ebefa0fe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:42.132361 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2c38313b-1dca-4d81-a5e7-f8d8ebefa0fe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:42.140391 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2c38313b-1dca-4d81-a5e7-f8d8ebefa0fe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:42.145008 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2c38313b-1dca-4d81-a5e7-f8d8ebefa0fe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:42.145008 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2c38313b-1dca-4d81-a5e7-f8d8ebefa0fe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.162505 Sep 16 08:08:42.145008 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 226/428] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:41 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:08:42.727463 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fb38a3ff-c37e-4b3c-a053-b39be77c8707 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:42.727946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-fb38a3ff-c37e-4b3c-a053-b39be77c8707 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:42.733566 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb38a3ff-c37e-4b3c-a053-b39be77c8707 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:42.734055 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb38a3ff-c37e-4b3c-a053-b39be77c8707 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:42.734498 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb38a3ff-c37e-4b3c-a053-b39be77c8707 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:42.735366 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb38a3ff-c37e-4b3c-a053-b39be77c8707 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:42.736003 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb38a3ff-c37e-4b3c-a053-b39be77c8707 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:42.736434 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb38a3ff-c37e-4b3c-a053-b39be77c8707 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:42.800956 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fb38a3ff-c37e-4b3c-a053-b39be77c8707 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:42.806944 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-fb38a3ff-c37e-4b3c-a053-b39be77c8707 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1191 microversion: 2.1 time: 0.084877 Sep 16 08:08:42.807609 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 203/429] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:42 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1191 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:43.168168 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-05874109-6c32-4fff-8808-f9d6773b70fb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:43.168776 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-05874109-6c32-4fff-8808-f9d6773b70fb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:43.175313 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-05874109-6c32-4fff-8808-f9d6773b70fb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:43.175792 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-05874109-6c32-4fff-8808-f9d6773b70fb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:43.176226 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-05874109-6c32-4fff-8808-f9d6773b70fb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:43.176911 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-05874109-6c32-4fff-8808-f9d6773b70fb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:43.177401 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-05874109-6c32-4fff-8808-f9d6773b70fb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:43.177814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-05874109-6c32-4fff-8808-f9d6773b70fb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:43.312642 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-05874109-6c32-4fff-8808-f9d6773b70fb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:43.322084 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-05874109-6c32-4fff-8808-f9d6773b70fb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:43.323280 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-05874109-6c32-4fff-8808-f9d6773b70fb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:43.324439 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-05874109-6c32-4fff-8808-f9d6773b70fb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.160207 Sep 16 08:08:43.325005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 227/430] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:43 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:43.829389 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-035da162-3f0a-4098-9faa-7b2e873c73c4 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:43.830037 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-035da162-3f0a-4098-9faa-7b2e873c73c4 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:43.836699 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-035da162-3f0a-4098-9faa-7b2e873c73c4 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:43.837430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-035da162-3f0a-4098-9faa-7b2e873c73c4 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:43.838249 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-035da162-3f0a-4098-9faa-7b2e873c73c4 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:43.839159 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-035da162-3f0a-4098-9faa-7b2e873c73c4 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:43.839772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-035da162-3f0a-4098-9faa-7b2e873c73c4 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:43.840535 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-035da162-3f0a-4098-9faa-7b2e873c73c4 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:43.903926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-035da162-3f0a-4098-9faa-7b2e873c73c4 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:43.912753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-035da162-3f0a-4098-9faa-7b2e873c73c4 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1199 microversion: 2.1 time: 0.087248 Sep 16 08:08:43.913310 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 204/431] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:43 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1199 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:44.350219 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-31861158-7550-4ba9-83df-68dd9fb7d56d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:44.350794 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-31861158-7550-4ba9-83df-68dd9fb7d56d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:44.357443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31861158-7550-4ba9-83df-68dd9fb7d56d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:44.357931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31861158-7550-4ba9-83df-68dd9fb7d56d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:44.358365 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31861158-7550-4ba9-83df-68dd9fb7d56d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:44.359081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31861158-7550-4ba9-83df-68dd9fb7d56d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:44.359575 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31861158-7550-4ba9-83df-68dd9fb7d56d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:44.359999 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31861158-7550-4ba9-83df-68dd9fb7d56d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:44.575119 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-31861158-7550-4ba9-83df-68dd9fb7d56d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:44.585147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-31861158-7550-4ba9-83df-68dd9fb7d56d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:44.587552 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-31861158-7550-4ba9-83df-68dd9fb7d56d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:44.589131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-31861158-7550-4ba9-83df-68dd9fb7d56d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.243648 Sep 16 08:08:44.590180 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 228/432] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:44 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:44.935619 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b35d9032-af37-44d3-85a1-2b9bb688c46e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:44.938461 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b35d9032-af37-44d3-85a1-2b9bb688c46e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:44.943989 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b35d9032-af37-44d3-85a1-2b9bb688c46e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:44.944485 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b35d9032-af37-44d3-85a1-2b9bb688c46e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:44.944925 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b35d9032-af37-44d3-85a1-2b9bb688c46e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:44.945632 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b35d9032-af37-44d3-85a1-2b9bb688c46e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:44.946194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b35d9032-af37-44d3-85a1-2b9bb688c46e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:44.946985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b35d9032-af37-44d3-85a1-2b9bb688c46e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:45.081489 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b35d9032-af37-44d3-85a1-2b9bb688c46e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:45.089204 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b35d9032-af37-44d3-85a1-2b9bb688c46e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1277 microversion: 2.1 time: 0.157547 Sep 16 08:08:45.098715 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 205/433] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:44 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1277 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:45.476622 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-34802ee2-4670-4145-8b28-f1d74d584453 req-92f23f72-b54a-4401-bd37-11eaa84582c5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea19d9a7-5838-4755-b520-7f6fa0ebde3d", "tag": "7d637a8f-0225-4aa9-bc24-95e5a1a77fff"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:45.487811 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-34802ee2-4670-4145-8b28-f1d74d584453 req-92f23f72-b54a-4401-bd37-11eaa84582c5 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:45.491571 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-34802ee2-4670-4145-8b28-f1d74d584453 req-92f23f72-b54a-4401-bd37-11eaa84582c5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:45.491571 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-34802ee2-4670-4145-8b28-f1d74d584453 req-92f23f72-b54a-4401-bd37-11eaa84582c5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:45.500994 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-34802ee2-4670-4145-8b28-f1d74d584453 req-92f23f72-b54a-4401-bd37-11eaa84582c5 service nova] Creating event network-changed:7d637a8f-0225-4aa9-bc24-95e5a1a77fff for instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d on hv-cinder-74014 Sep 16 08:08:45.506073 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-34802ee2-4670-4145-8b28-f1d74d584453 req-92f23f72-b54a-4401-bd37-11eaa84582c5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033606 Sep 16 08:08:45.506966 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 229/434] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:08:45 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:08:45.615228 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0c802c9e-4842-4e8b-91c3-496eeca7c4b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:45.615846 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0c802c9e-4842-4e8b-91c3-496eeca7c4b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:45.621825 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0c802c9e-4842-4e8b-91c3-496eeca7c4b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:45.622258 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0c802c9e-4842-4e8b-91c3-496eeca7c4b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:45.622729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0c802c9e-4842-4e8b-91c3-496eeca7c4b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:45.623515 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0c802c9e-4842-4e8b-91c3-496eeca7c4b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:45.623878 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0c802c9e-4842-4e8b-91c3-496eeca7c4b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:45.624309 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0c802c9e-4842-4e8b-91c3-496eeca7c4b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:45.772145 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0c802c9e-4842-4e8b-91c3-496eeca7c4b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:45.780568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0c802c9e-4842-4e8b-91c3-496eeca7c4b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:45.782945 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0c802c9e-4842-4e8b-91c3-496eeca7c4b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:45.784104 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0c802c9e-4842-4e8b-91c3-496eeca7c4b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.172959 Sep 16 08:08:45.784666 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 206/435] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:45 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:46.114569 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6bc6e53f-1201-4c78-a746-9b3cd1f78884 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:46.115459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6bc6e53f-1201-4c78-a746-9b3cd1f78884 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:46.121552 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6bc6e53f-1201-4c78-a746-9b3cd1f78884 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:46.122034 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6bc6e53f-1201-4c78-a746-9b3cd1f78884 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:46.122467 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6bc6e53f-1201-4c78-a746-9b3cd1f78884 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:46.123183 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6bc6e53f-1201-4c78-a746-9b3cd1f78884 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:46.123639 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6bc6e53f-1201-4c78-a746-9b3cd1f78884 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:46.124059 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6bc6e53f-1201-4c78-a746-9b3cd1f78884 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:46.532375 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6bc6e53f-1201-4c78-a746-9b3cd1f78884 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:46.540327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6bc6e53f-1201-4c78-a746-9b3cd1f78884 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1265 microversion: 2.1 time: 0.430659 Sep 16 08:08:46.541120 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 230/436] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:46 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1265 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:46.809470 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-018a0874-fe12-4bfc-bbaa-b0d7bb4cb5d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:46.810073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-018a0874-fe12-4bfc-bbaa-b0d7bb4cb5d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:46.816896 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-018a0874-fe12-4bfc-bbaa-b0d7bb4cb5d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:46.817380 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-018a0874-fe12-4bfc-bbaa-b0d7bb4cb5d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:46.817819 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-018a0874-fe12-4bfc-bbaa-b0d7bb4cb5d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:46.818551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-018a0874-fe12-4bfc-bbaa-b0d7bb4cb5d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:46.819033 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-018a0874-fe12-4bfc-bbaa-b0d7bb4cb5d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:46.819462 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-018a0874-fe12-4bfc-bbaa-b0d7bb4cb5d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:46.948560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-018a0874-fe12-4bfc-bbaa-b0d7bb4cb5d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:46.957014 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-018a0874-fe12-4bfc-bbaa-b0d7bb4cb5d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:46.958482 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-018a0874-fe12-4bfc-bbaa-b0d7bb4cb5d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:46.959804 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-018a0874-fe12-4bfc-bbaa-b0d7bb4cb5d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.154270 Sep 16 08:08:46.960568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 207/437] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:46 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:47.563617 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-56203327-d909-4339-b611-e50c0961cb2e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:47.564230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-56203327-d909-4339-b611-e50c0961cb2e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:47.571338 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56203327-d909-4339-b611-e50c0961cb2e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:47.571817 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56203327-d909-4339-b611-e50c0961cb2e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:47.572253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56203327-d909-4339-b611-e50c0961cb2e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:47.572933 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56203327-d909-4339-b611-e50c0961cb2e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:47.573382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56203327-d909-4339-b611-e50c0961cb2e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:47.573804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56203327-d909-4339-b611-e50c0961cb2e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:47.708352 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-56203327-d909-4339-b611-e50c0961cb2e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:47.716730 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-56203327-d909-4339-b611-e50c0961cb2e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1265 microversion: 2.1 time: 0.157244 Sep 16 08:08:47.717296 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 231/438] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:47 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:47.985249 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-88d54571-93d2-45e3-8cc9-033c0edec54d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:47.985953 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-88d54571-93d2-45e3-8cc9-033c0edec54d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:47.993115 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-88d54571-93d2-45e3-8cc9-033c0edec54d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:47.993600 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-88d54571-93d2-45e3-8cc9-033c0edec54d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:47.994036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-88d54571-93d2-45e3-8cc9-033c0edec54d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:47.994744 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-88d54571-93d2-45e3-8cc9-033c0edec54d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:47.995202 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-88d54571-93d2-45e3-8cc9-033c0edec54d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:47.995631 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-88d54571-93d2-45e3-8cc9-033c0edec54d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:48.124978 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-88d54571-93d2-45e3-8cc9-033c0edec54d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:48.133795 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-88d54571-93d2-45e3-8cc9-033c0edec54d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:48.135278 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-88d54571-93d2-45e3-8cc9-033c0edec54d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:48.136445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-88d54571-93d2-45e3-8cc9-033c0edec54d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.155240 Sep 16 08:08:48.136999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 208/439] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:47 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:48.739780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2338f603-ffcf-4c4f-8215-366608b52e09 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:48.740395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2338f603-ffcf-4c4f-8215-366608b52e09 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:48.746888 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2338f603-ffcf-4c4f-8215-366608b52e09 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:48.750119 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2338f603-ffcf-4c4f-8215-366608b52e09 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:48.750119 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2338f603-ffcf-4c4f-8215-366608b52e09 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:48.750119 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2338f603-ffcf-4c4f-8215-366608b52e09 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:48.750119 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2338f603-ffcf-4c4f-8215-366608b52e09 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:48.750593 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2338f603-ffcf-4c4f-8215-366608b52e09 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:48.882196 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2338f603-ffcf-4c4f-8215-366608b52e09 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:48.889944 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2338f603-ffcf-4c4f-8215-366608b52e09 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1265 microversion: 2.1 time: 0.154078 Sep 16 08:08:48.890505 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 232/440] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:48 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1265 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:08:49.161410 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7d96c01f-915e-4dda-9c65-c662eb7b6df8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:49.162025 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7d96c01f-915e-4dda-9c65-c662eb7b6df8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:49.168821 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7d96c01f-915e-4dda-9c65-c662eb7b6df8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:49.169325 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7d96c01f-915e-4dda-9c65-c662eb7b6df8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:49.169764 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7d96c01f-915e-4dda-9c65-c662eb7b6df8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:49.170478 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7d96c01f-915e-4dda-9c65-c662eb7b6df8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:49.170971 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7d96c01f-915e-4dda-9c65-c662eb7b6df8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:49.171412 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7d96c01f-915e-4dda-9c65-c662eb7b6df8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:49.303546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7d96c01f-915e-4dda-9c65-c662eb7b6df8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:49.309323 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7d96c01f-915e-4dda-9c65-c662eb7b6df8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:49.310989 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7d96c01f-915e-4dda-9c65-c662eb7b6df8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:49.311973 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7d96c01f-915e-4dda-9c65-c662eb7b6df8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.154444 Sep 16 08:08:49.312505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 209/441] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:49 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:08:49.913807 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b920ae9b-3724-478b-b901-81ea2d7af681 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:49.914416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b920ae9b-3724-478b-b901-81ea2d7af681 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:49.921025 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b920ae9b-3724-478b-b901-81ea2d7af681 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:49.921508 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b920ae9b-3724-478b-b901-81ea2d7af681 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:49.921944 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b920ae9b-3724-478b-b901-81ea2d7af681 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:49.922630 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b920ae9b-3724-478b-b901-81ea2d7af681 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:49.923110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b920ae9b-3724-478b-b901-81ea2d7af681 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:49.923534 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b920ae9b-3724-478b-b901-81ea2d7af681 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:50.013420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:50.059995 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b920ae9b-3724-478b-b901-81ea2d7af681 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:50.067572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b920ae9b-3724-478b-b901-81ea2d7af681 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1265 microversion: 2.1 time: 0.158304 Sep 16 08:08:50.068149 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 233/442] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:49 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1265 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:08:50.338582 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a897bdf5-94e8-4079-a9f1-b554ce5f5027 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:50.339234 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a897bdf5-94e8-4079-a9f1-b554ce5f5027 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:50.345992 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a897bdf5-94e8-4079-a9f1-b554ce5f5027 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:50.346510 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a897bdf5-94e8-4079-a9f1-b554ce5f5027 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:50.347144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a897bdf5-94e8-4079-a9f1-b554ce5f5027 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:50.347854 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a897bdf5-94e8-4079-a9f1-b554ce5f5027 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:50.348313 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a897bdf5-94e8-4079-a9f1-b554ce5f5027 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:50.348747 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a897bdf5-94e8-4079-a9f1-b554ce5f5027 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:50.479974 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a897bdf5-94e8-4079-a9f1-b554ce5f5027 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:50.488129 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a897bdf5-94e8-4079-a9f1-b554ce5f5027 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:50.489588 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a897bdf5-94e8-4079-a9f1-b554ce5f5027 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:50.490765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a897bdf5-94e8-4079-a9f1-b554ce5f5027 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.156610 Sep 16 08:08:50.491327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 210/443] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:50 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:51.091014 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-45dce017-ef53-4845-9c46-98ddd2651a26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:51.091628 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-45dce017-ef53-4845-9c46-98ddd2651a26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:51.093602 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=8 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:51.098759 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45dce017-ef53-4845-9c46-98ddd2651a26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:51.099243 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45dce017-ef53-4845-9c46-98ddd2651a26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:51.099674 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45dce017-ef53-4845-9c46-98ddd2651a26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:51.100362 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45dce017-ef53-4845-9c46-98ddd2651a26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:51.100869 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45dce017-ef53-4845-9c46-98ddd2651a26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:51.101292 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45dce017-ef53-4845-9c46-98ddd2651a26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:51.233073 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-45dce017-ef53-4845-9c46-98ddd2651a26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:51.241762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-45dce017-ef53-4845-9c46-98ddd2651a26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1265 microversion: 2.1 time: 0.154128 Sep 16 08:08:51.246113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 234/444] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:51 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1265 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:51.516751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5806199c-6c50-4d06-b78a-bbb0f5f9c67d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:51.517409 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5806199c-6c50-4d06-b78a-bbb0f5f9c67d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:51.523813 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5806199c-6c50-4d06-b78a-bbb0f5f9c67d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:51.524282 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5806199c-6c50-4d06-b78a-bbb0f5f9c67d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:51.524726 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5806199c-6c50-4d06-b78a-bbb0f5f9c67d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:51.525494 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5806199c-6c50-4d06-b78a-bbb0f5f9c67d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:51.525955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5806199c-6c50-4d06-b78a-bbb0f5f9c67d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:51.526390 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5806199c-6c50-4d06-b78a-bbb0f5f9c67d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:51.660963 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5806199c-6c50-4d06-b78a-bbb0f5f9c67d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:51.669849 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5806199c-6c50-4d06-b78a-bbb0f5f9c67d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:51.671329 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5806199c-6c50-4d06-b78a-bbb0f5f9c67d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:51.672486 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5806199c-6c50-4d06-b78a-bbb0f5f9c67d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.159662 Sep 16 08:08:51.673039 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 211/445] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:51 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:52.264371 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5763c529-5d10-418a-b7fb-7acd6bd8269d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:52.264976 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5763c529-5d10-418a-b7fb-7acd6bd8269d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:52.272592 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5763c529-5d10-418a-b7fb-7acd6bd8269d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:52.273089 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5763c529-5d10-418a-b7fb-7acd6bd8269d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:52.273532 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5763c529-5d10-418a-b7fb-7acd6bd8269d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:52.274218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5763c529-5d10-418a-b7fb-7acd6bd8269d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:52.274670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5763c529-5d10-418a-b7fb-7acd6bd8269d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:52.275189 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5763c529-5d10-418a-b7fb-7acd6bd8269d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:52.409009 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5763c529-5d10-418a-b7fb-7acd6bd8269d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:52.417020 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5763c529-5d10-418a-b7fb-7acd6bd8269d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1265 microversion: 2.1 time: 0.156493 Sep 16 08:08:52.417614 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 235/446] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:52 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:52.699111 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9188f05a-0d6b-4e66-9495-a7f3f93f8574 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:52.699725 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9188f05a-0d6b-4e66-9495-a7f3f93f8574 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:52.706445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9188f05a-0d6b-4e66-9495-a7f3f93f8574 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:52.706951 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9188f05a-0d6b-4e66-9495-a7f3f93f8574 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:52.707389 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9188f05a-0d6b-4e66-9495-a7f3f93f8574 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:52.708088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9188f05a-0d6b-4e66-9495-a7f3f93f8574 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:52.708541 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9188f05a-0d6b-4e66-9495-a7f3f93f8574 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:52.708967 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9188f05a-0d6b-4e66-9495-a7f3f93f8574 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:52.839677 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9188f05a-0d6b-4e66-9495-a7f3f93f8574 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:52.847997 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9188f05a-0d6b-4e66-9495-a7f3f93f8574 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:52.849469 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9188f05a-0d6b-4e66-9495-a7f3f93f8574 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:52.851173 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9188f05a-0d6b-4e66-9495-a7f3f93f8574 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.156083 Sep 16 08:08:52.851723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 212/447] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:52 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:53.439551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c41240c9-66c1-4944-8be4-8a1fbcb3424f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:53.440182 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c41240c9-66c1-4944-8be4-8a1fbcb3424f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:53.447170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c41240c9-66c1-4944-8be4-8a1fbcb3424f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:53.447644 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c41240c9-66c1-4944-8be4-8a1fbcb3424f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:53.448074 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c41240c9-66c1-4944-8be4-8a1fbcb3424f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:53.448750 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c41240c9-66c1-4944-8be4-8a1fbcb3424f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:53.449230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c41240c9-66c1-4944-8be4-8a1fbcb3424f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:53.449652 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c41240c9-66c1-4944-8be4-8a1fbcb3424f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:53.592384 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c41240c9-66c1-4944-8be4-8a1fbcb3424f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:53.595902 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c41240c9-66c1-4944-8be4-8a1fbcb3424f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1265 microversion: 2.1 time: 0.160219 Sep 16 08:08:53.596463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 236/448] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:53 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1265 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:53.876312 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b8c84759-d067-4a9d-9367-2d46463266a1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:53.876900 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b8c84759-d067-4a9d-9367-2d46463266a1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:53.883391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8c84759-d067-4a9d-9367-2d46463266a1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:53.883872 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8c84759-d067-4a9d-9367-2d46463266a1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:53.884301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8c84759-d067-4a9d-9367-2d46463266a1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:53.884987 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8c84759-d067-4a9d-9367-2d46463266a1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:53.885432 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8c84759-d067-4a9d-9367-2d46463266a1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:53.885855 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8c84759-d067-4a9d-9367-2d46463266a1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:54.015656 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b8c84759-d067-4a9d-9367-2d46463266a1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:54.024226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b8c84759-d067-4a9d-9367-2d46463266a1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:54.025685 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b8c84759-d067-4a9d-9367-2d46463266a1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:54.026883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b8c84759-d067-4a9d-9367-2d46463266a1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.154573 Sep 16 08:08:54.027444 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 213/449] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:53 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:54.619977 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8e8700ea-e189-4549-a548-1e4a5d627946 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:54.620592 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8e8700ea-e189-4549-a548-1e4a5d627946 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:54.627029 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e8700ea-e189-4549-a548-1e4a5d627946 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:54.627515 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e8700ea-e189-4549-a548-1e4a5d627946 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:54.627960 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e8700ea-e189-4549-a548-1e4a5d627946 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:54.628647 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e8700ea-e189-4549-a548-1e4a5d627946 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:54.629104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e8700ea-e189-4549-a548-1e4a5d627946 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:54.630059 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e8700ea-e189-4549-a548-1e4a5d627946 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:54.764680 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8e8700ea-e189-4549-a548-1e4a5d627946 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:54.770819 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8e8700ea-e189-4549-a548-1e4a5d627946 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1265 microversion: 2.1 time: 0.155191 Sep 16 08:08:54.771445 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 237/450] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:54 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1265 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:55.053884 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-77ba9152-9aeb-4471-99e8-1da27a341a2e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:55.054428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-77ba9152-9aeb-4471-99e8-1da27a341a2e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:55.060864 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-77ba9152-9aeb-4471-99e8-1da27a341a2e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:55.061377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-77ba9152-9aeb-4471-99e8-1da27a341a2e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:55.061841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-77ba9152-9aeb-4471-99e8-1da27a341a2e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:55.062561 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-77ba9152-9aeb-4471-99e8-1da27a341a2e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:55.063044 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-77ba9152-9aeb-4471-99e8-1da27a341a2e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:55.063471 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-77ba9152-9aeb-4471-99e8-1da27a341a2e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:55.193633 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-77ba9152-9aeb-4471-99e8-1da27a341a2e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:55.197229 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:55.202126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-77ba9152-9aeb-4471-99e8-1da27a341a2e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:55.203818 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-77ba9152-9aeb-4471-99e8-1da27a341a2e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:55.205050 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-77ba9152-9aeb-4471-99e8-1da27a341a2e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.155859 Sep 16 08:08:55.205616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 214/451] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:55 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:55.793026 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-930ec648-7355-48a0-87f9-51ee3042df31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:55.793658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-930ec648-7355-48a0-87f9-51ee3042df31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:55.800061 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-930ec648-7355-48a0-87f9-51ee3042df31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:55.800542 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-930ec648-7355-48a0-87f9-51ee3042df31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:55.800976 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-930ec648-7355-48a0-87f9-51ee3042df31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:55.801659 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-930ec648-7355-48a0-87f9-51ee3042df31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:55.802139 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-930ec648-7355-48a0-87f9-51ee3042df31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:55.802562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-930ec648-7355-48a0-87f9-51ee3042df31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:55.937539 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-930ec648-7355-48a0-87f9-51ee3042df31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:55.946044 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-930ec648-7355-48a0-87f9-51ee3042df31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1265 microversion: 2.1 time: 0.156818 Sep 16 08:08:55.946622 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 238/452] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:55 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1265 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:56.229758 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-41dd2f9c-25f4-4f07-a1f8-d6b842155c06 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:56.230374 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-41dd2f9c-25f4-4f07-a1f8-d6b842155c06 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:56.237593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-41dd2f9c-25f4-4f07-a1f8-d6b842155c06 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:56.238074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-41dd2f9c-25f4-4f07-a1f8-d6b842155c06 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:56.238513 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-41dd2f9c-25f4-4f07-a1f8-d6b842155c06 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:56.239309 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-41dd2f9c-25f4-4f07-a1f8-d6b842155c06 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:56.239766 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-41dd2f9c-25f4-4f07-a1f8-d6b842155c06 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:56.240191 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-41dd2f9c-25f4-4f07-a1f8-d6b842155c06 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:56.375520 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-41dd2f9c-25f4-4f07-a1f8-d6b842155c06 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:56.384293 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-41dd2f9c-25f4-4f07-a1f8-d6b842155c06 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:56.385792 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-41dd2f9c-25f4-4f07-a1f8-d6b842155c06 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:56.387004 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-41dd2f9c-25f4-4f07-a1f8-d6b842155c06 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.161304 Sep 16 08:08:56.387560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 215/453] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:56 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:56.941808 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-cc56fa4d-5b3f-4053-8b54-f538c1689ae2 req-7bde2f73-fe9c-4d1b-bbe5-a3c6b4e4f764 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea19d9a7-5838-4755-b520-7f6fa0ebde3d", "name": "network-vif-plugged", "status": "completed", "tag": "7d637a8f-0225-4aa9-bc24-95e5a1a77fff"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:08:56.951673 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-cc56fa4d-5b3f-4053-8b54-f538c1689ae2 req-7bde2f73-fe9c-4d1b-bbe5-a3c6b4e4f764 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:56.952156 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-cc56fa4d-5b3f-4053-8b54-f538c1689ae2 req-7bde2f73-fe9c-4d1b-bbe5-a3c6b4e4f764 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:56.952589 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-cc56fa4d-5b3f-4053-8b54-f538c1689ae2 req-7bde2f73-fe9c-4d1b-bbe5-a3c6b4e4f764 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:56.963785 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-cc56fa4d-5b3f-4053-8b54-f538c1689ae2 req-7bde2f73-fe9c-4d1b-bbe5-a3c6b4e4f764 service nova] Creating event network-vif-plugged:7d637a8f-0225-4aa9-bc24-95e5a1a77fff for instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d on hv-cinder-74014 Sep 16 08:08:56.968872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-cc56fa4d-5b3f-4053-8b54-f538c1689ae2 req-7bde2f73-fe9c-4d1b-bbe5-a3c6b4e4f764 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030894 Sep 16 08:08:56.969485 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 239/454] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:08:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:08:56.970062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ab634bc3-a5ae-417c-93f0-004730f80012 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:56.970953 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ab634bc3-a5ae-417c-93f0-004730f80012 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:56.977610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ab634bc3-a5ae-417c-93f0-004730f80012 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:56.978093 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ab634bc3-a5ae-417c-93f0-004730f80012 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:56.978546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ab634bc3-a5ae-417c-93f0-004730f80012 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:56.979298 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ab634bc3-a5ae-417c-93f0-004730f80012 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:56.979752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ab634bc3-a5ae-417c-93f0-004730f80012 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:56.980182 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ab634bc3-a5ae-417c-93f0-004730f80012 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:57.109154 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ab634bc3-a5ae-417c-93f0-004730f80012 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:57.117187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ab634bc3-a5ae-417c-93f0-004730f80012 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1265 microversion: 2.1 time: 0.151980 Sep 16 08:08:57.117758 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 216/455] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:56 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1265 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:08:57.411978 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4bdd795a-bfe8-49d9-b496-2e16fe043139 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:57.412595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4bdd795a-bfe8-49d9-b496-2e16fe043139 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:57.418709 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4bdd795a-bfe8-49d9-b496-2e16fe043139 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:57.419218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4bdd795a-bfe8-49d9-b496-2e16fe043139 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:57.419654 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4bdd795a-bfe8-49d9-b496-2e16fe043139 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:57.420356 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4bdd795a-bfe8-49d9-b496-2e16fe043139 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:57.420811 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4bdd795a-bfe8-49d9-b496-2e16fe043139 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:57.421244 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4bdd795a-bfe8-49d9-b496-2e16fe043139 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:57.602615 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4bdd795a-bfe8-49d9-b496-2e16fe043139 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:57.610747 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4bdd795a-bfe8-49d9-b496-2e16fe043139 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:57.612222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4bdd795a-bfe8-49d9-b496-2e16fe043139 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:57.613376 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4bdd795a-bfe8-49d9-b496-2e16fe043139 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.205819 Sep 16 08:08:57.613938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 240/456] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:57 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:58.139693 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ee535c22-c4b2-4aab-b48c-cc5c79995a24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:58.140335 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ee535c22-c4b2-4aab-b48c-cc5c79995a24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:58.146897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ee535c22-c4b2-4aab-b48c-cc5c79995a24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:58.147434 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ee535c22-c4b2-4aab-b48c-cc5c79995a24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:58.147879 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ee535c22-c4b2-4aab-b48c-cc5c79995a24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:58.148577 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ee535c22-c4b2-4aab-b48c-cc5c79995a24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:58.149036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ee535c22-c4b2-4aab-b48c-cc5c79995a24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:58.149469 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ee535c22-c4b2-4aab-b48c-cc5c79995a24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:58.276073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ee535c22-c4b2-4aab-b48c-cc5c79995a24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:58.283977 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ee535c22-c4b2-4aab-b48c-cc5c79995a24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1265 microversion: 2.1 time: 0.148201 Sep 16 08:08:58.288213 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 217/457] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:58 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1265 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:58.638589 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7351d0cb-bb8a-43fc-ae5f-f9bb258e349d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:58.639225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7351d0cb-bb8a-43fc-ae5f-f9bb258e349d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:58.645577 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7351d0cb-bb8a-43fc-ae5f-f9bb258e349d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:58.646052 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7351d0cb-bb8a-43fc-ae5f-f9bb258e349d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:58.654554 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7351d0cb-bb8a-43fc-ae5f-f9bb258e349d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:58.654554 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7351d0cb-bb8a-43fc-ae5f-f9bb258e349d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:58.654554 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7351d0cb-bb8a-43fc-ae5f-f9bb258e349d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:58.654554 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7351d0cb-bb8a-43fc-ae5f-f9bb258e349d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:58.778861 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7351d0cb-bb8a-43fc-ae5f-f9bb258e349d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:58.787147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7351d0cb-bb8a-43fc-ae5f-f9bb258e349d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:58.788621 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7351d0cb-bb8a-43fc-ae5f-f9bb258e349d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:58.789780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7351d0cb-bb8a-43fc-ae5f-f9bb258e349d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.155071 Sep 16 08:08:58.794803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 241/458] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:58 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:08:59.307111 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1280fdac-183a-46f0-96a3-8dfbb12674d8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:59.307755 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1280fdac-183a-46f0-96a3-8dfbb12674d8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:59.314187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1280fdac-183a-46f0-96a3-8dfbb12674d8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:59.314666 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1280fdac-183a-46f0-96a3-8dfbb12674d8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:59.315201 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1280fdac-183a-46f0-96a3-8dfbb12674d8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:59.315890 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1280fdac-183a-46f0-96a3-8dfbb12674d8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:59.316346 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1280fdac-183a-46f0-96a3-8dfbb12674d8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:59.316773 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1280fdac-183a-46f0-96a3-8dfbb12674d8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:59.447387 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1280fdac-183a-46f0-96a3-8dfbb12674d8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:59.455011 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1280fdac-183a-46f0-96a3-8dfbb12674d8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1265 microversion: 2.1 time: 0.152284 Sep 16 08:08:59.455582 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 218/459] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:08:59 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1265 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:08:59.814831 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-240cdd70-8c3f-4867-bde5-205df4ab4a09 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:08:59.815476 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-240cdd70-8c3f-4867-bde5-205df4ab4a09 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:08:59.824892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-240cdd70-8c3f-4867-bde5-205df4ab4a09 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:59.824892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-240cdd70-8c3f-4867-bde5-205df4ab4a09 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:59.824892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-240cdd70-8c3f-4867-bde5-205df4ab4a09 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:59.824892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-240cdd70-8c3f-4867-bde5-205df4ab4a09 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:08:59.825182 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-240cdd70-8c3f-4867-bde5-205df4ab4a09 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:08:59.825182 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-240cdd70-8c3f-4867-bde5-205df4ab4a09 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:08:59.845207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:08:59.953514 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-240cdd70-8c3f-4867-bde5-205df4ab4a09 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:59.962156 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-240cdd70-8c3f-4867-bde5-205df4ab4a09 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:59.963629 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-240cdd70-8c3f-4867-bde5-205df4ab4a09 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:08:59.964775 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-240cdd70-8c3f-4867-bde5-205df4ab4a09 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.153967 Sep 16 08:08:59.965342 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 242/460] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:08:59 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:00.477946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-eddd8902-9361-4449-bfaa-d72742ed5307 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:00.478562 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-eddd8902-9361-4449-bfaa-d72742ed5307 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:00.484964 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eddd8902-9361-4449-bfaa-d72742ed5307 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:00.485450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eddd8902-9361-4449-bfaa-d72742ed5307 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:00.485888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eddd8902-9361-4449-bfaa-d72742ed5307 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:00.486582 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eddd8902-9361-4449-bfaa-d72742ed5307 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:00.487065 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eddd8902-9361-4449-bfaa-d72742ed5307 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:00.487500 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eddd8902-9361-4449-bfaa-d72742ed5307 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:00.614103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-eddd8902-9361-4449-bfaa-d72742ed5307 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:00.622226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-eddd8902-9361-4449-bfaa-d72742ed5307 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1451 microversion: 2.1 time: 0.148432 Sep 16 08:09:00.622815 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 219/461] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:00 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1451 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:00.644979 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7bf04cbc-bcf2-4709-886c-d9f3211b9460 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:00.645586 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7bf04cbc-bcf2-4709-886c-d9f3211b9460 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:00.651748 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7bf04cbc-bcf2-4709-886c-d9f3211b9460 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:00.652231 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7bf04cbc-bcf2-4709-886c-d9f3211b9460 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:00.652664 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7bf04cbc-bcf2-4709-886c-d9f3211b9460 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:00.653342 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7bf04cbc-bcf2-4709-886c-d9f3211b9460 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:00.653792 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7bf04cbc-bcf2-4709-886c-d9f3211b9460 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:00.654213 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7bf04cbc-bcf2-4709-886c-d9f3211b9460 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:00.788314 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7bf04cbc-bcf2-4709-886c-d9f3211b9460 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:00.796165 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7bf04cbc-bcf2-4709-886c-d9f3211b9460 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1451 microversion: 2.1 time: 0.154956 Sep 16 08:09:00.796727 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 243/462] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:00 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1451 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:00.989424 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-953af9c0-afa2-4409-a44c-c32034163b21 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:00.990062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-953af9c0-afa2-4409-a44c-c32034163b21 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:00.996537 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-953af9c0-afa2-4409-a44c-c32034163b21 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:00.997019 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-953af9c0-afa2-4409-a44c-c32034163b21 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:00.997458 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-953af9c0-afa2-4409-a44c-c32034163b21 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:00.998588 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-953af9c0-afa2-4409-a44c-c32034163b21 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:00.998588 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-953af9c0-afa2-4409-a44c-c32034163b21 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:00.999031 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-953af9c0-afa2-4409-a44c-c32034163b21 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:01.129605 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-953af9c0-afa2-4409-a44c-c32034163b21 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:01.137921 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-953af9c0-afa2-4409-a44c-c32034163b21 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:01.139480 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-953af9c0-afa2-4409-a44c-c32034163b21 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:01.140704 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-953af9c0-afa2-4409-a44c-c32034163b21 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.155296 Sep 16 08:09:01.141259 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 220/463] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:00 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:02.165412 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7a004771-a7bf-4db2-8314-911c687c9f57 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:02.166088 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7a004771-a7bf-4db2-8314-911c687c9f57 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:02.172870 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a004771-a7bf-4db2-8314-911c687c9f57 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:02.173393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a004771-a7bf-4db2-8314-911c687c9f57 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:02.173887 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a004771-a7bf-4db2-8314-911c687c9f57 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:02.174591 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a004771-a7bf-4db2-8314-911c687c9f57 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:02.175140 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a004771-a7bf-4db2-8314-911c687c9f57 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:02.175574 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a004771-a7bf-4db2-8314-911c687c9f57 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:02.425221 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7a004771-a7bf-4db2-8314-911c687c9f57 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:02.433998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7a004771-a7bf-4db2-8314-911c687c9f57 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:02.435618 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7a004771-a7bf-4db2-8314-911c687c9f57 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:02.436850 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7a004771-a7bf-4db2-8314-911c687c9f57 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1746 microversion: 2.20 time: 0.275395 Sep 16 08:09:02.437492 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 244/464] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:02 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1746 bytes in 277 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:02.898195 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-1d47570a-9671-48f3-9c26-1f48f36ca5bb req-e1185aee-0fe8-4a09-b259-16df0370b66f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea19d9a7-5838-4755-b520-7f6fa0ebde3d", "tag": "7d637a8f-0225-4aa9-bc24-95e5a1a77fff"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:02.909072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-1d47570a-9671-48f3-9c26-1f48f36ca5bb req-e1185aee-0fe8-4a09-b259-16df0370b66f service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:02.909695 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-1d47570a-9671-48f3-9c26-1f48f36ca5bb req-e1185aee-0fe8-4a09-b259-16df0370b66f service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:02.910140 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-1d47570a-9671-48f3-9c26-1f48f36ca5bb req-e1185aee-0fe8-4a09-b259-16df0370b66f service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:02.924287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-1d47570a-9671-48f3-9c26-1f48f36ca5bb req-e1185aee-0fe8-4a09-b259-16df0370b66f service nova] Creating event network-changed:7d637a8f-0225-4aa9-bc24-95e5a1a77fff for instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d on hv-cinder-74014 Sep 16 08:09:02.929529 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-1d47570a-9671-48f3-9c26-1f48f36ca5bb req-e1185aee-0fe8-4a09-b259-16df0370b66f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034874 Sep 16 08:09:02.930310 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 221/465] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:09:02 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:09:03.466417 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7e5f1191-57cb-4420-835f-8d51f4ca7537 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:03.467406 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7e5f1191-57cb-4420-835f-8d51f4ca7537 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:03.474552 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7e5f1191-57cb-4420-835f-8d51f4ca7537 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:03.475233 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7e5f1191-57cb-4420-835f-8d51f4ca7537 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:03.475787 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7e5f1191-57cb-4420-835f-8d51f4ca7537 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:03.476593 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7e5f1191-57cb-4420-835f-8d51f4ca7537 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:03.477634 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7e5f1191-57cb-4420-835f-8d51f4ca7537 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:03.478298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7e5f1191-57cb-4420-835f-8d51f4ca7537 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:03.618303 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7e5f1191-57cb-4420-835f-8d51f4ca7537 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:03.627942 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7e5f1191-57cb-4420-835f-8d51f4ca7537 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:03.629411 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7e5f1191-57cb-4420-835f-8d51f4ca7537 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:03.630595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7e5f1191-57cb-4420-835f-8d51f4ca7537 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1746 microversion: 2.20 time: 0.168114 Sep 16 08:09:03.631408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 245/466] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:03 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1746 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:03.839037 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a77d0a58-5a97-439f-9c6d-abaa68e1357a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Action: 'action', calling method: >, body: {"reboot": {"type": "SOFT"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:03.842182 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a77d0a58-5a97-439f-9c6d-abaa68e1357a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:03.852618 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a77d0a58-5a97-439f-9c6d-abaa68e1357a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:03.852618 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a77d0a58-5a97-439f-9c6d-abaa68e1357a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:03.852618 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a77d0a58-5a97-439f-9c6d-abaa68e1357a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:03.852618 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a77d0a58-5a97-439f-9c6d-abaa68e1357a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:03.853070 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a77d0a58-5a97-439f-9c6d-abaa68e1357a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:03.853070 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a77d0a58-5a97-439f-9c6d-abaa68e1357a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:04.063828 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a77d0a58-5a97-439f-9c6d-abaa68e1357a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "POST /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/action" status: 202 len: 0 microversion: 2.1 time: 0.230808 Sep 16 08:09:04.072320 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 222/467] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:09:03 2022] POST /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/action => generated 0 bytes in 240 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:09:04.080427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f779ff3c-19ff-40ec-9098-ca214a7605f7 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:04.081074 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f779ff3c-19ff-40ec-9098-ca214a7605f7 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:04.091447 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f779ff3c-19ff-40ec-9098-ca214a7605f7 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:04.092028 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f779ff3c-19ff-40ec-9098-ca214a7605f7 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:04.092485 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f779ff3c-19ff-40ec-9098-ca214a7605f7 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:04.093204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f779ff3c-19ff-40ec-9098-ca214a7605f7 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:04.093689 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f779ff3c-19ff-40ec-9098-ca214a7605f7 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:04.099822 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f779ff3c-19ff-40ec-9098-ca214a7605f7 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:04.244121 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f779ff3c-19ff-40ec-9098-ca214a7605f7 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:04.252398 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f779ff3c-19ff-40ec-9098-ca214a7605f7 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1750 microversion: 2.1 time: 0.183623 Sep 16 08:09:04.252998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 246/468] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:04 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1750 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:04.661725 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6f66cf2e-713c-4714-b693-dc72fc2d7f6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:04.662490 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6f66cf2e-713c-4714-b693-dc72fc2d7f6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:04.669209 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6f66cf2e-713c-4714-b693-dc72fc2d7f6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:04.669699 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6f66cf2e-713c-4714-b693-dc72fc2d7f6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:04.670137 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6f66cf2e-713c-4714-b693-dc72fc2d7f6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:04.670955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6f66cf2e-713c-4714-b693-dc72fc2d7f6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:04.671411 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6f66cf2e-713c-4714-b693-dc72fc2d7f6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:04.671876 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6f66cf2e-713c-4714-b693-dc72fc2d7f6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:04.803122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6f66cf2e-713c-4714-b693-dc72fc2d7f6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:04.811787 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6f66cf2e-713c-4714-b693-dc72fc2d7f6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:04.813242 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6f66cf2e-713c-4714-b693-dc72fc2d7f6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:04.814428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6f66cf2e-713c-4714-b693-dc72fc2d7f6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1746 microversion: 2.20 time: 0.157288 Sep 16 08:09:04.815188 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 223/469] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:04 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1746 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:05.283130 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1657c73e-c524-46b7-ad5c-af033f5d7cde tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:05.283796 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1657c73e-c524-46b7-ad5c-af033f5d7cde tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:05.290410 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1657c73e-c524-46b7-ad5c-af033f5d7cde tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:05.290920 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1657c73e-c524-46b7-ad5c-af033f5d7cde tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:05.291352 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1657c73e-c524-46b7-ad5c-af033f5d7cde tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:05.292067 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1657c73e-c524-46b7-ad5c-af033f5d7cde tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:05.292516 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1657c73e-c524-46b7-ad5c-af033f5d7cde tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:05.292967 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1657c73e-c524-46b7-ad5c-af033f5d7cde tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:05.450565 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1657c73e-c524-46b7-ad5c-af033f5d7cde tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:05.459018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1657c73e-c524-46b7-ad5c-af033f5d7cde tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.180823 Sep 16 08:09:05.459590 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 247/470] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:05 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:05.840699 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7182dc2a-a614-4b54-bf74-000a5873964a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:05.841306 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7182dc2a-a614-4b54-bf74-000a5873964a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:05.847416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7182dc2a-a614-4b54-bf74-000a5873964a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:05.847901 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7182dc2a-a614-4b54-bf74-000a5873964a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:05.848338 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7182dc2a-a614-4b54-bf74-000a5873964a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:05.849031 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7182dc2a-a614-4b54-bf74-000a5873964a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:05.849487 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7182dc2a-a614-4b54-bf74-000a5873964a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:05.849912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7182dc2a-a614-4b54-bf74-000a5873964a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:05.979924 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7182dc2a-a614-4b54-bf74-000a5873964a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:05.988038 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7182dc2a-a614-4b54-bf74-000a5873964a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:05.989486 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7182dc2a-a614-4b54-bf74-000a5873964a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:05.990639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7182dc2a-a614-4b54-bf74-000a5873964a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1746 microversion: 2.20 time: 0.154386 Sep 16 08:09:05.991224 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 224/471] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:05 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1746 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:06.481779 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8c3db84e-9ccb-48f7-8743-e7f9865b50db tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:06.482503 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8c3db84e-9ccb-48f7-8743-e7f9865b50db tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:06.489051 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8c3db84e-9ccb-48f7-8743-e7f9865b50db tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:06.489533 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8c3db84e-9ccb-48f7-8743-e7f9865b50db tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:06.489971 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8c3db84e-9ccb-48f7-8743-e7f9865b50db tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:06.490668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8c3db84e-9ccb-48f7-8743-e7f9865b50db tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:06.491153 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8c3db84e-9ccb-48f7-8743-e7f9865b50db tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:06.491586 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8c3db84e-9ccb-48f7-8743-e7f9865b50db tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:06.645005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8c3db84e-9ccb-48f7-8743-e7f9865b50db tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:06.654476 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8c3db84e-9ccb-48f7-8743-e7f9865b50db tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.176946 Sep 16 08:09:06.655565 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 248/472] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:06 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:06.967545 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-b9db948c-1bb1-43f7-8e9c-75dc47e7430f req-4d15720d-0801-4435-8420-9c33d5edaa50 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c", "name": "network-vif-plugged", "status": "completed", "tag": "0104ad2b-b1c9-455f-a512-cdc1dd34408e"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:06.985130 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-b9db948c-1bb1-43f7-8e9c-75dc47e7430f req-4d15720d-0801-4435-8420-9c33d5edaa50 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:06.985710 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-b9db948c-1bb1-43f7-8e9c-75dc47e7430f req-4d15720d-0801-4435-8420-9c33d5edaa50 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:06.989466 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-b9db948c-1bb1-43f7-8e9c-75dc47e7430f req-4d15720d-0801-4435-8420-9c33d5edaa50 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:07.003898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-b9db948c-1bb1-43f7-8e9c-75dc47e7430f req-4d15720d-0801-4435-8420-9c33d5edaa50 service nova] Creating event network-vif-plugged:0104ad2b-b1c9-455f-a512-cdc1dd34408e for instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c on hv-cinder-74014 Sep 16 08:09:07.014142 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-b9db948c-1bb1-43f7-8e9c-75dc47e7430f req-4d15720d-0801-4435-8420-9c33d5edaa50 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.052672 Sep 16 08:09:07.014975 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 225/473] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:09:06 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 55 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:09:07.019940 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-de59ef84-f3be-4bba-9084-e16b3cf0f229 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:07.020575 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-de59ef84-f3be-4bba-9084-e16b3cf0f229 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:07.028125 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-de59ef84-f3be-4bba-9084-e16b3cf0f229 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:07.028862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-de59ef84-f3be-4bba-9084-e16b3cf0f229 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:07.029302 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-de59ef84-f3be-4bba-9084-e16b3cf0f229 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:07.030176 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-de59ef84-f3be-4bba-9084-e16b3cf0f229 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:07.030940 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-de59ef84-f3be-4bba-9084-e16b3cf0f229 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:07.031397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-de59ef84-f3be-4bba-9084-e16b3cf0f229 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:07.264066 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-de59ef84-f3be-4bba-9084-e16b3cf0f229 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:07.265529 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-de59ef84-f3be-4bba-9084-e16b3cf0f229 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:07.267227 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-de59ef84-f3be-4bba-9084-e16b3cf0f229 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:07.268656 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-de59ef84-f3be-4bba-9084-e16b3cf0f229 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1741 microversion: 2.20 time: 0.256382 Sep 16 08:09:07.286032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 249/474] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:07 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1741 bytes in 274 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:07.684762 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1df54dc5-8b7b-401f-867e-6f4ba8ce32cd tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:07.686028 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1df54dc5-8b7b-401f-867e-6f4ba8ce32cd tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:07.692656 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1df54dc5-8b7b-401f-867e-6f4ba8ce32cd tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:07.693628 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1df54dc5-8b7b-401f-867e-6f4ba8ce32cd tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:07.694089 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1df54dc5-8b7b-401f-867e-6f4ba8ce32cd tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:07.694915 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1df54dc5-8b7b-401f-867e-6f4ba8ce32cd tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:07.695616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1df54dc5-8b7b-401f-867e-6f4ba8ce32cd tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:07.696234 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1df54dc5-8b7b-401f-867e-6f4ba8ce32cd tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:07.866092 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1df54dc5-8b7b-401f-867e-6f4ba8ce32cd tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:07.877638 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1df54dc5-8b7b-401f-867e-6f4ba8ce32cd tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.198225 Sep 16 08:09:07.878231 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 226/475] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:07 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:08.298024 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-957ec6c8-086e-4e3e-8246-af2edd9067e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:08.298762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-957ec6c8-086e-4e3e-8246-af2edd9067e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:08.304278 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-22f59dbc-ab15-4e92-ad04-9da7574a97ae tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:08.304867 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-22f59dbc-ab15-4e92-ad04-9da7574a97ae tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:08.312049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-957ec6c8-086e-4e3e-8246-af2edd9067e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:08.312551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-957ec6c8-086e-4e3e-8246-af2edd9067e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:08.313000 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-957ec6c8-086e-4e3e-8246-af2edd9067e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:08.313211 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22f59dbc-ab15-4e92-ad04-9da7574a97ae tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:08.313722 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-957ec6c8-086e-4e3e-8246-af2edd9067e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:08.313826 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22f59dbc-ab15-4e92-ad04-9da7574a97ae tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:08.314168 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22f59dbc-ab15-4e92-ad04-9da7574a97ae tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:08.314308 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-957ec6c8-086e-4e3e-8246-af2edd9067e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:08.314605 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-957ec6c8-086e-4e3e-8246-af2edd9067e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:08.314905 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22f59dbc-ab15-4e92-ad04-9da7574a97ae tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:08.315363 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22f59dbc-ab15-4e92-ad04-9da7574a97ae tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:08.323912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22f59dbc-ab15-4e92-ad04-9da7574a97ae tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:08.493923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-957ec6c8-086e-4e3e-8246-af2edd9067e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:08.505618 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-957ec6c8-086e-4e3e-8246-af2edd9067e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:08.507671 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-957ec6c8-086e-4e3e-8246-af2edd9067e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:08.509136 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-957ec6c8-086e-4e3e-8246-af2edd9067e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1741 microversion: 2.20 time: 0.215195 Sep 16 08:09:08.509856 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 250/476] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:08 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1741 bytes in 216 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:08.551271 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-22f59dbc-ab15-4e92-ad04-9da7574a97ae tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lazy-loading 'services' on Instance uuid fe69a551-c89a-4b4f-a026-5e23f39a1355 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:09:08.828730 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-22f59dbc-ab15-4e92-ad04-9da7574a97ae tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/os-volume_attachments/05470364-d81a-4cf6-a06b-0bcb78a5fa95" status: 202 len: 0 microversion: 2.1 time: 0.528415 Sep 16 08:09:08.834628 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 227/477] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Sep 16 08:09:08 2022] DELETE /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/os-volume_attachments/05470364-d81a-4cf6-a06b-0bcb78a5fa95 => generated 0 bytes in 530 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:09:08.923460 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-be25c786-8d48-447d-81fc-0946f5cca8bf tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:08.925423 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-be25c786-8d48-447d-81fc-0946f5cca8bf tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:08.945994 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-be25c786-8d48-447d-81fc-0946f5cca8bf tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:08.947678 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-be25c786-8d48-447d-81fc-0946f5cca8bf tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:08.948390 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-be25c786-8d48-447d-81fc-0946f5cca8bf tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:08.949928 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-be25c786-8d48-447d-81fc-0946f5cca8bf tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:08.950636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-be25c786-8d48-447d-81fc-0946f5cca8bf tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:08.951335 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-be25c786-8d48-447d-81fc-0946f5cca8bf tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:09.214456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-be25c786-8d48-447d-81fc-0946f5cca8bf tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:09.228105 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-be25c786-8d48-447d-81fc-0946f5cca8bf tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.325589 Sep 16 08:09:09.228781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 251/478] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:08 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 327 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:09.541324 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-17b00bb0-05ae-47d8-87b6-195cb5ba53b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:09.542870 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-17b00bb0-05ae-47d8-87b6-195cb5ba53b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:09.549752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-17b00bb0-05ae-47d8-87b6-195cb5ba53b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:09.552096 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-17b00bb0-05ae-47d8-87b6-195cb5ba53b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:09.552096 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-17b00bb0-05ae-47d8-87b6-195cb5ba53b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:09.552096 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-17b00bb0-05ae-47d8-87b6-195cb5ba53b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:09.552096 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-17b00bb0-05ae-47d8-87b6-195cb5ba53b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:09.552531 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-17b00bb0-05ae-47d8-87b6-195cb5ba53b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:09.711235 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-17b00bb0-05ae-47d8-87b6-195cb5ba53b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:09.722305 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-17b00bb0-05ae-47d8-87b6-195cb5ba53b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:09.723987 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-17b00bb0-05ae-47d8-87b6-195cb5ba53b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:09.725706 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-17b00bb0-05ae-47d8-87b6-195cb5ba53b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1741 microversion: 2.20 time: 0.190770 Sep 16 08:09:09.735829 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 228/479] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:09 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1741 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:10.251583 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-698efdd8-646d-4d49-a61d-88b6032b4ba1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:10.252199 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-698efdd8-646d-4d49-a61d-88b6032b4ba1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:10.254118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=74,nova_api:INSERT=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:10.258816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-698efdd8-646d-4d49-a61d-88b6032b4ba1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:10.259306 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-698efdd8-646d-4d49-a61d-88b6032b4ba1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:10.259744 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-698efdd8-646d-4d49-a61d-88b6032b4ba1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:10.262258 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-698efdd8-646d-4d49-a61d-88b6032b4ba1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:10.262756 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-698efdd8-646d-4d49-a61d-88b6032b4ba1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:10.265913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-698efdd8-646d-4d49-a61d-88b6032b4ba1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:10.317301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-54cc6dfa-8a4f-477f-96d6-f179aa658435 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:10.327129 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-54cc6dfa-8a4f-477f-96d6-f179aa658435 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:10.332455 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=59 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:10.338851 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-54cc6dfa-8a4f-477f-96d6-f179aa658435 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:10.339430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-54cc6dfa-8a4f-477f-96d6-f179aa658435 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:10.340006 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-54cc6dfa-8a4f-477f-96d6-f179aa658435 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:10.340781 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-54cc6dfa-8a4f-477f-96d6-f179aa658435 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:10.346062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-54cc6dfa-8a4f-477f-96d6-f179aa658435 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:10.346839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-54cc6dfa-8a4f-477f-96d6-f179aa658435 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:10.374706 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-54cc6dfa-8a4f-477f-96d6-f179aa658435 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce/ips" status: 200 len: 150 microversion: 2.1 time: 0.065440 Sep 16 08:09:10.375703 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 229/480] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Sep 16 08:09:10 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce/ips => generated 150 bytes in 70 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:09:10.389798 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-370fe505-af0d-4362-865c-21eeeddc356e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "17d53de9-2afe-4288-ad69-afce393e4fcd"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:10.392276 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-370fe505-af0d-4362-865c-21eeeddc356e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:10.398661 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-370fe505-af0d-4362-865c-21eeeddc356e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:10.400121 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-370fe505-af0d-4362-865c-21eeeddc356e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:10.400747 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-370fe505-af0d-4362-865c-21eeeddc356e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:10.401642 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-370fe505-af0d-4362-865c-21eeeddc356e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:10.402257 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-370fe505-af0d-4362-865c-21eeeddc356e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:10.402890 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-370fe505-af0d-4362-865c-21eeeddc356e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:10.458433 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-698efdd8-646d-4d49-a61d-88b6032b4ba1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:10.468877 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-698efdd8-646d-4d49-a61d-88b6032b4ba1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.221145 Sep 16 08:09:10.469956 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 252/481] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:10 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:10.529438 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-370fe505-af0d-4362-865c-21eeeddc356e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Invalid volume: volume 17d53de9-2afe-4288-ad69-afce393e4fcd is already attached to instances: 547e4d8b-02bd-4033-82b3-04db0ba60fe5 Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-370fe505-af0d-4362-865c-21eeeddc356e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: POST /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce/os-volume_attachments HTTP/1.1 Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 74 Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:09:10.532751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:09:10.534670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:09:10.534670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:09:10.534670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:09:10.534670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:09:10.534670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:09:10.534670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:09:10.534670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:09:10.534670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:09:10.534670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:09:10.534670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Sep 16 08:09:10.534670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {"volumeAttachment": {"volumeId": "17d53de9-2afe-4288-ad69-afce393e4fcd"}} Sep 16 08:09:10.534670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Invalid volume: volume 17d53de9-2afe-4288-ad69-afce393e4fcd is already attached to instances: 547e4d8b-02bd-4033-82b3-04db0ba60fe5 Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'server_id': '6372a5c9-25ed-4593-861f-78a0f8cf03ce', 'body': {'volumeAttachment': {'volumeId': '17d53de9-2afe-4288-ad69-afce393e4fcd'}}} Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 17d53de9-2afe-4288-ad69-afce393e4fcd is already attached to instances: 547e4d8b-02bd-4033-82b3-04db0ba60fe5 Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:10.535893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 17d53de9-2afe-4288-ad69-afce393e4fcd is already attached to instances: 547e4d8b-02bd-4033-82b3-04db0ba60fe5 Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:09:10.537378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:09:10.538853 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:09:10.538853 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:09:10.538853 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:09:10.538853 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 17d53de9-2afe-4288-ad69-afce393e4fcd is already attached to instances: 547e4d8b-02bd-4033-82b3-04db0ba60fe5 Sep 16 08:09:10.538853 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:10.538853 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-370fe505-af0d-4362-865c-21eeeddc356e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 400 to user: Invalid volume: volume 17d53de9-2afe-4288-ad69-afce393e4fcd is already attached to instances: 547e4d8b-02bd-4033-82b3-04db0ba60fe5 {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:09:10.538853 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-370fe505-af0d-4362-865c-21eeeddc356e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.152293 Sep 16 08:09:10.538853 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 230/482] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:09:10 2022] POST /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce/os-volume_attachments => generated 174 bytes in 155 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 08:09:10.550865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3b092c7f-4994-4220-921b-3ce2060804a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:10.551617 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3b092c7f-4994-4220-921b-3ce2060804a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:10.559300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3b092c7f-4994-4220-921b-3ce2060804a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:10.559934 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3b092c7f-4994-4220-921b-3ce2060804a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:10.560289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3b092c7f-4994-4220-921b-3ce2060804a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:10.561045 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3b092c7f-4994-4220-921b-3ce2060804a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:10.561518 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3b092c7f-4994-4220-921b-3ce2060804a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:10.561954 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3b092c7f-4994-4220-921b-3ce2060804a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:10.611570 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3b092c7f-4994-4220-921b-3ce2060804a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:09:10.757868 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f7813254-22d6-47b1-b8db-dd1f29ff0797 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:10.759280 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f7813254-22d6-47b1-b8db-dd1f29ff0797 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:10.767324 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7813254-22d6-47b1-b8db-dd1f29ff0797 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:10.768041 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7813254-22d6-47b1-b8db-dd1f29ff0797 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:10.768795 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7813254-22d6-47b1-b8db-dd1f29ff0797 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:10.769788 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7813254-22d6-47b1-b8db-dd1f29ff0797 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:10.770658 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7813254-22d6-47b1-b8db-dd1f29ff0797 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:10.771270 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7813254-22d6-47b1-b8db-dd1f29ff0797 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:10.798191 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:10.945034 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3b092c7f-4994-4220-921b-3ce2060804a1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 204 len: 0 microversion: 2.1 time: 0.397788 Sep 16 08:09:10.947249 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 253/483] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:09:10 2022] DELETE /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 0 bytes in 399 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:09:10.954429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f7813254-22d6-47b1-b8db-dd1f29ff0797 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:10.957894 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f7813254-22d6-47b1-b8db-dd1f29ff0797 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:10.959789 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f7813254-22d6-47b1-b8db-dd1f29ff0797 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:10.959975 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-703e67a5-9236-4be9-94fc-e2c1a40fef85 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:10.960650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-703e67a5-9236-4be9-94fc-e2c1a40fef85 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:10.961488 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f7813254-22d6-47b1-b8db-dd1f29ff0797 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1741 microversion: 2.20 time: 0.209388 Sep 16 08:09:10.962458 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 231/484] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:10 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1741 bytes in 212 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:10.973269 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-703e67a5-9236-4be9-94fc-e2c1a40fef85 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:10.973626 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-703e67a5-9236-4be9-94fc-e2c1a40fef85 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:10.974071 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-703e67a5-9236-4be9-94fc-e2c1a40fef85 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:10.974820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-703e67a5-9236-4be9-94fc-e2c1a40fef85 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:10.975291 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-703e67a5-9236-4be9-94fc-e2c1a40fef85 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:10.975716 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-703e67a5-9236-4be9-94fc-e2c1a40fef85 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:11.049390 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5557127d-a8d6-4f74-af7b-1102eed70686 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Action: 'action', calling method: >, body: {"os-stop": {}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:11.056945 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5557127d-a8d6-4f74-af7b-1102eed70686 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:11.057673 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5557127d-a8d6-4f74-af7b-1102eed70686 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:11.058122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5557127d-a8d6-4f74-af7b-1102eed70686 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:11.123638 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5557127d-a8d6-4f74-af7b-1102eed70686 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Going to try to stop instance {{(pid=121047) force_stop /opt/stack/nova/nova/compute/api.py:2762}} Sep 16 08:09:11.159826 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-703e67a5-9236-4be9-94fc-e2c1a40fef85 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:11.168408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-703e67a5-9236-4be9-94fc-e2c1a40fef85 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1681 microversion: 2.1 time: 0.212599 Sep 16 08:09:11.169092 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 254/485] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:10 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1681 bytes in 214 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:11.346546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5557127d-a8d6-4f74-af7b-1102eed70686 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "POST /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/action" status: 202 len: 0 microversion: 2.1 time: 0.300647 Sep 16 08:09:11.347717 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 232/486] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:09:11 2022] POST /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/action => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 08:09:11.358519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-bab7f4c7-23e4-4c62-b3f3-28936b8e35bb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:11.362673 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-bab7f4c7-23e4-4c62-b3f3-28936b8e35bb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:11.367341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bab7f4c7-23e4-4c62-b3f3-28936b8e35bb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:11.367846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bab7f4c7-23e4-4c62-b3f3-28936b8e35bb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:11.368321 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bab7f4c7-23e4-4c62-b3f3-28936b8e35bb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:11.369155 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bab7f4c7-23e4-4c62-b3f3-28936b8e35bb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:11.369630 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bab7f4c7-23e4-4c62-b3f3-28936b8e35bb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:11.370053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bab7f4c7-23e4-4c62-b3f3-28936b8e35bb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:11.493943 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-43227af7-cd75-4bf0-b45f-76de281dd378 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:11.495019 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-43227af7-cd75-4bf0-b45f-76de281dd378 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:11.504513 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-43227af7-cd75-4bf0-b45f-76de281dd378 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:11.505690 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-43227af7-cd75-4bf0-b45f-76de281dd378 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:11.506654 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-43227af7-cd75-4bf0-b45f-76de281dd378 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:11.508373 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-43227af7-cd75-4bf0-b45f-76de281dd378 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:11.510824 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-43227af7-cd75-4bf0-b45f-76de281dd378 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:11.512472 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-43227af7-cd75-4bf0-b45f-76de281dd378 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:11.535901 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-bab7f4c7-23e4-4c62-b3f3-28936b8e35bb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:11.544534 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-bab7f4c7-23e4-4c62-b3f3-28936b8e35bb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1675 microversion: 2.1 time: 0.192659 Sep 16 08:09:11.545446 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 255/487] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:11 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1675 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:11.690021 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-43227af7-cd75-4bf0-b45f-76de281dd378 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:11.704555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-43227af7-cd75-4bf0-b45f-76de281dd378 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.214836 Sep 16 08:09:11.705421 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 233/488] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:11 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:11.987039 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cccbfcd7-feca-46be-b0fb-ff58d8a7fa02 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:11.987803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cccbfcd7-feca-46be-b0fb-ff58d8a7fa02 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:11.994547 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cccbfcd7-feca-46be-b0fb-ff58d8a7fa02 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:11.995154 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cccbfcd7-feca-46be-b0fb-ff58d8a7fa02 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:11.995730 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cccbfcd7-feca-46be-b0fb-ff58d8a7fa02 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:11.996634 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cccbfcd7-feca-46be-b0fb-ff58d8a7fa02 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:11.997149 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cccbfcd7-feca-46be-b0fb-ff58d8a7fa02 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:11.997636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cccbfcd7-feca-46be-b0fb-ff58d8a7fa02 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:12.156566 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cccbfcd7-feca-46be-b0fb-ff58d8a7fa02 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:12.165258 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cccbfcd7-feca-46be-b0fb-ff58d8a7fa02 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:12.166942 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cccbfcd7-feca-46be-b0fb-ff58d8a7fa02 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:12.168191 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cccbfcd7-feca-46be-b0fb-ff58d8a7fa02 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1741 microversion: 2.20 time: 0.185023 Sep 16 08:09:12.182702 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 256/489] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:11 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1741 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:12.192940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fd8b22b1-8eaa-4fbc-939b-036fde79dbae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:12.196838 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-fd8b22b1-8eaa-4fbc-939b-036fde79dbae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:12.201340 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fd8b22b1-8eaa-4fbc-939b-036fde79dbae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:12.201921 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fd8b22b1-8eaa-4fbc-939b-036fde79dbae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:12.202450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fd8b22b1-8eaa-4fbc-939b-036fde79dbae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:12.203291 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fd8b22b1-8eaa-4fbc-939b-036fde79dbae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:12.203857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fd8b22b1-8eaa-4fbc-939b-036fde79dbae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:12.204391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fd8b22b1-8eaa-4fbc-939b-036fde79dbae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:12.346425 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fd8b22b1-8eaa-4fbc-939b-036fde79dbae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:12.354986 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-fd8b22b1-8eaa-4fbc-939b-036fde79dbae tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1681 microversion: 2.1 time: 0.165872 Sep 16 08:09:12.370905 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 234/490] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:12 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1681 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:12.569441 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b34db4ac-bc2c-4a56-88ad-a255cfacb720 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:12.571064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b34db4ac-bc2c-4a56-88ad-a255cfacb720 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:12.578455 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b34db4ac-bc2c-4a56-88ad-a255cfacb720 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:12.579243 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b34db4ac-bc2c-4a56-88ad-a255cfacb720 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:12.579864 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b34db4ac-bc2c-4a56-88ad-a255cfacb720 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:12.580865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b34db4ac-bc2c-4a56-88ad-a255cfacb720 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:12.581490 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b34db4ac-bc2c-4a56-88ad-a255cfacb720 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:12.582069 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b34db4ac-bc2c-4a56-88ad-a255cfacb720 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:12.603537 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:12.733052 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-301199f1-6b5b-45b1-a588-9532989da5a2 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:12.737031 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b34db4ac-bc2c-4a56-88ad-a255cfacb720 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:12.741478 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-301199f1-6b5b-45b1-a588-9532989da5a2 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:12.746725 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b34db4ac-bc2c-4a56-88ad-a255cfacb720 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1675 microversion: 2.1 time: 0.181261 Sep 16 08:09:12.747334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 257/491] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:12 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1675 bytes in 183 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:12.754943 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-301199f1-6b5b-45b1-a588-9532989da5a2 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:12.755638 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-301199f1-6b5b-45b1-a588-9532989da5a2 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:12.756259 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-301199f1-6b5b-45b1-a588-9532989da5a2 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:12.757723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-301199f1-6b5b-45b1-a588-9532989da5a2 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:12.758351 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-301199f1-6b5b-45b1-a588-9532989da5a2 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:12.759593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-301199f1-6b5b-45b1-a588-9532989da5a2 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:12.913291 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-301199f1-6b5b-45b1-a588-9532989da5a2 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:12.923278 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-301199f1-6b5b-45b1-a588-9532989da5a2 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.195874 Sep 16 08:09:12.923865 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 235/492] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:12 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:13.193658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1cad836b-c073-456e-9c0e-cb23dae0656c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:13.194182 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1cad836b-c073-456e-9c0e-cb23dae0656c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:13.200685 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1cad836b-c073-456e-9c0e-cb23dae0656c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:13.201166 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1cad836b-c073-456e-9c0e-cb23dae0656c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:13.201596 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1cad836b-c073-456e-9c0e-cb23dae0656c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:13.202290 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1cad836b-c073-456e-9c0e-cb23dae0656c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:13.202769 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1cad836b-c073-456e-9c0e-cb23dae0656c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:13.203223 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1cad836b-c073-456e-9c0e-cb23dae0656c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:13.377575 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c51c5375-6267-4e56-877b-f144f239debb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:13.378095 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c51c5375-6267-4e56-877b-f144f239debb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:13.385308 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c51c5375-6267-4e56-877b-f144f239debb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:13.385792 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c51c5375-6267-4e56-877b-f144f239debb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:13.386224 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c51c5375-6267-4e56-877b-f144f239debb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:13.386960 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c51c5375-6267-4e56-877b-f144f239debb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:13.387407 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c51c5375-6267-4e56-877b-f144f239debb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:13.387832 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c51c5375-6267-4e56-877b-f144f239debb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:13.482498 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1cad836b-c073-456e-9c0e-cb23dae0656c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:13.496554 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1cad836b-c073-456e-9c0e-cb23dae0656c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:13.497996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1cad836b-c073-456e-9c0e-cb23dae0656c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:13.499191 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1cad836b-c073-456e-9c0e-cb23dae0656c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1741 microversion: 2.20 time: 0.309686 Sep 16 08:09:13.501777 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 258/493] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:13 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1741 bytes in 313 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:13.538835 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c51c5375-6267-4e56-877b-f144f239debb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:13.546938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c51c5375-6267-4e56-877b-f144f239debb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1681 microversion: 2.1 time: 0.173419 Sep 16 08:09:13.547518 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 236/494] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:13 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1681 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:13.771111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-95d94a21-9b23-4e54-a9a8-61133330ee37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:13.771705 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-95d94a21-9b23-4e54-a9a8-61133330ee37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:13.789747 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-95d94a21-9b23-4e54-a9a8-61133330ee37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:13.791311 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-95d94a21-9b23-4e54-a9a8-61133330ee37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:13.792011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-95d94a21-9b23-4e54-a9a8-61133330ee37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:13.792960 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-95d94a21-9b23-4e54-a9a8-61133330ee37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:13.793649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-95d94a21-9b23-4e54-a9a8-61133330ee37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:13.794435 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-95d94a21-9b23-4e54-a9a8-61133330ee37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:13.949029 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b34ed7e2-828f-4360-8f22-22932264135c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:13.950104 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b34ed7e2-828f-4360-8f22-22932264135c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:13.957873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b34ed7e2-828f-4360-8f22-22932264135c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:13.958605 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b34ed7e2-828f-4360-8f22-22932264135c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:13.959327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b34ed7e2-828f-4360-8f22-22932264135c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:13.960447 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b34ed7e2-828f-4360-8f22-22932264135c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:13.961013 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b34ed7e2-828f-4360-8f22-22932264135c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:13.961545 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b34ed7e2-828f-4360-8f22-22932264135c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:14.059067 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-95d94a21-9b23-4e54-a9a8-61133330ee37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:14.073589 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-95d94a21-9b23-4e54-a9a8-61133330ee37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1675 microversion: 2.1 time: 0.307086 Sep 16 08:09:14.079220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 259/495] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:13 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1675 bytes in 311 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:14.197846 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b34ed7e2-828f-4360-8f22-22932264135c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:14.210701 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b34ed7e2-828f-4360-8f22-22932264135c tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.267473 Sep 16 08:09:14.230609 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 237/496] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:13 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:14.286472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-5b1031b3-25b5-44f9-8d42-cfc6a6ffa371 req-4da76111-e46e-4247-b9f0-9e6083e063b6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6372a5c9-25ed-4593-861f-78a0f8cf03ce", "name": "network-vif-deleted", "tag": "0587b75f-a06f-40a0-8e4d-3ac7308fa48a"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:14.297888 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-5b1031b3-25b5-44f9-8d42-cfc6a6ffa371 req-4da76111-e46e-4247-b9f0-9e6083e063b6 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:14.298468 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-5b1031b3-25b5-44f9-8d42-cfc6a6ffa371 req-4da76111-e46e-4247-b9f0-9e6083e063b6 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:14.301145 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-5b1031b3-25b5-44f9-8d42-cfc6a6ffa371 req-4da76111-e46e-4247-b9f0-9e6083e063b6 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:14.319153 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-5b1031b3-25b5-44f9-8d42-cfc6a6ffa371 req-4da76111-e46e-4247-b9f0-9e6083e063b6 service nova] Creating event network-vif-deleted:0587b75f-a06f-40a0-8e4d-3ac7308fa48a for instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce on hv-cinder-74014 Sep 16 08:09:14.327065 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-5b1031b3-25b5-44f9-8d42-cfc6a6ffa371 req-4da76111-e46e-4247-b9f0-9e6083e063b6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.044467 Sep 16 08:09:14.331580 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 260/497] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:09:14 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:09:14.525208 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b01fda74-44a9-4ebe-b6ee-d962887a5c7e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:14.526175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b01fda74-44a9-4ebe-b6ee-d962887a5c7e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:14.536355 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b01fda74-44a9-4ebe-b6ee-d962887a5c7e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:14.538868 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b01fda74-44a9-4ebe-b6ee-d962887a5c7e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:14.539443 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b01fda74-44a9-4ebe-b6ee-d962887a5c7e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:14.543040 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b01fda74-44a9-4ebe-b6ee-d962887a5c7e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:14.543641 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b01fda74-44a9-4ebe-b6ee-d962887a5c7e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:14.544175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b01fda74-44a9-4ebe-b6ee-d962887a5c7e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:14.572413 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1fd8ccb8-f76d-4a67-85f3-8b72bbd7e022 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:14.580155 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1fd8ccb8-f76d-4a67-85f3-8b72bbd7e022 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:14.599765 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1fd8ccb8-f76d-4a67-85f3-8b72bbd7e022 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:14.603770 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1fd8ccb8-f76d-4a67-85f3-8b72bbd7e022 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:14.604466 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1fd8ccb8-f76d-4a67-85f3-8b72bbd7e022 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:14.605579 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1fd8ccb8-f76d-4a67-85f3-8b72bbd7e022 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:14.614050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1fd8ccb8-f76d-4a67-85f3-8b72bbd7e022 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:14.614938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1fd8ccb8-f76d-4a67-85f3-8b72bbd7e022 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.006s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:14.734658 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b01fda74-44a9-4ebe-b6ee-d962887a5c7e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:14.747279 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b01fda74-44a9-4ebe-b6ee-d962887a5c7e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:14.749127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b01fda74-44a9-4ebe-b6ee-d962887a5c7e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:14.750478 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b01fda74-44a9-4ebe-b6ee-d962887a5c7e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1741 microversion: 2.20 time: 0.229575 Sep 16 08:09:14.766153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 238/498] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:14 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1741 bytes in 246 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:14.771475 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1fd8ccb8-f76d-4a67-85f3-8b72bbd7e022 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:14.800342 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1fd8ccb8-f76d-4a67-85f3-8b72bbd7e022 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1325 microversion: 2.1 time: 0.215157 Sep 16 08:09:14.800342 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 261/499] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:14 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1325 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:15.108127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-175f7bc2-a937-4bee-8f0b-46da6ba949cc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:15.109984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-175f7bc2-a937-4bee-8f0b-46da6ba949cc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:15.137573 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-175f7bc2-a937-4bee-8f0b-46da6ba949cc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:15.139929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-175f7bc2-a937-4bee-8f0b-46da6ba949cc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:15.140677 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-175f7bc2-a937-4bee-8f0b-46da6ba949cc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:15.141548 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-175f7bc2-a937-4bee-8f0b-46da6ba949cc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:15.142153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-175f7bc2-a937-4bee-8f0b-46da6ba949cc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:15.142759 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-175f7bc2-a937-4bee-8f0b-46da6ba949cc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:15.234054 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2bdec0e3-7300-4af8-979c-5f5555961d34 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:15.234914 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2bdec0e3-7300-4af8-979c-5f5555961d34 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:15.246412 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2bdec0e3-7300-4af8-979c-5f5555961d34 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:15.247097 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2bdec0e3-7300-4af8-979c-5f5555961d34 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:15.247739 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2bdec0e3-7300-4af8-979c-5f5555961d34 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:15.248675 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2bdec0e3-7300-4af8-979c-5f5555961d34 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:15.249456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2bdec0e3-7300-4af8-979c-5f5555961d34 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:15.252027 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2bdec0e3-7300-4af8-979c-5f5555961d34 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:15.519636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2bdec0e3-7300-4af8-979c-5f5555961d34 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:15.529051 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2bdec0e3-7300-4af8-979c-5f5555961d34 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.298871 Sep 16 08:09:15.543609 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 262/500] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:15 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 314 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:15.760619 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-175f7bc2-a937-4bee-8f0b-46da6ba949cc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:15.776275 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-175f7bc2-a937-4bee-8f0b-46da6ba949cc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1675 microversion: 2.1 time: 0.681519 Sep 16 08:09:15.777146 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 239/501] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:15 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1675 bytes in 684 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:15.778574 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5b294ab4-17b9-44c5-8716-763359304a3e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:15.779303 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5b294ab4-17b9-44c5-8716-763359304a3e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:15.792533 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b294ab4-17b9-44c5-8716-763359304a3e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:15.793287 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b294ab4-17b9-44c5-8716-763359304a3e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:15.797878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b294ab4-17b9-44c5-8716-763359304a3e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:15.798898 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b294ab4-17b9-44c5-8716-763359304a3e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:15.799440 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b294ab4-17b9-44c5-8716-763359304a3e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:15.799876 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b294ab4-17b9-44c5-8716-763359304a3e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:15.822236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:15.823283 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:15.842221 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:15.855612 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.013s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:15.856080 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:15.856845 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:15.857320 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:15.857754 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:15.912155 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:15.913236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:15.914194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:15.915072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lazy-loading 'fault' on Instance uuid 6372a5c9-25ed-4593-861f-78a0f8cf03ce {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:09:15.985124 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:15.996428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b8827fb7-d92c-4cec-aaa6-3ea0437eb749 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 200 len: 1330 microversion: 2.1 time: 0.179759 Sep 16 08:09:15.997107 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 240/502] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:15 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 1330 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:16.050333 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5b294ab4-17b9-44c5-8716-763359304a3e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:16.059717 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5b294ab4-17b9-44c5-8716-763359304a3e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:16.061495 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5b294ab4-17b9-44c5-8716-763359304a3e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:16.062854 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5b294ab4-17b9-44c5-8716-763359304a3e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1741 microversion: 2.20 time: 0.289656 Sep 16 08:09:16.063706 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 263/503] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:15 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1741 bytes in 291 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:16.559454 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f1fbbf71-dbd1-4d2a-995c-2995e4d2a746 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:16.560778 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f1fbbf71-dbd1-4d2a-995c-2995e4d2a746 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:16.569868 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f1fbbf71-dbd1-4d2a-995c-2995e4d2a746 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:16.570663 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f1fbbf71-dbd1-4d2a-995c-2995e4d2a746 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:16.571348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f1fbbf71-dbd1-4d2a-995c-2995e4d2a746 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:16.572252 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f1fbbf71-dbd1-4d2a-995c-2995e4d2a746 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:16.572862 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f1fbbf71-dbd1-4d2a-995c-2995e4d2a746 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:16.573434 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f1fbbf71-dbd1-4d2a-995c-2995e4d2a746 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:16.796659 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f1fbbf71-dbd1-4d2a-995c-2995e4d2a746 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:16.801736 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c76f73ba-065b-433c-845b-e51c51734c2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:16.807773 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c76f73ba-065b-433c-845b-e51c51734c2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:16.820263 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c76f73ba-065b-433c-845b-e51c51734c2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:16.820863 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f1fbbf71-dbd1-4d2a-995c-2995e4d2a746 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.267399 Sep 16 08:09:16.823017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c76f73ba-065b-433c-845b-e51c51734c2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:16.823637 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c76f73ba-065b-433c-845b-e51c51734c2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:16.824045 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 241/504] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:16 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 275 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:16.826089 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c76f73ba-065b-433c-845b-e51c51734c2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:16.826889 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c76f73ba-065b-433c-845b-e51c51734c2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:16.827507 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c76f73ba-065b-433c-845b-e51c51734c2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:16.995050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c76f73ba-065b-433c-845b-e51c51734c2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:17.005289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c76f73ba-065b-433c-845b-e51c51734c2a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1675 microversion: 2.1 time: 0.207352 Sep 16 08:09:17.008765 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 264/505] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:16 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1675 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:17.029874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-942afcc0-f024-46dc-9771-e42fb7052234 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:17.031807 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-942afcc0-f024-46dc-9771-e42fb7052234 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:17.038253 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-942afcc0-f024-46dc-9771-e42fb7052234 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:17.038773 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-942afcc0-f024-46dc-9771-e42fb7052234 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:17.039338 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-942afcc0-f024-46dc-9771-e42fb7052234 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:17.040965 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-942afcc0-f024-46dc-9771-e42fb7052234 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:17.041456 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-942afcc0-f024-46dc-9771-e42fb7052234 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:17.042326 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-942afcc0-f024-46dc-9771-e42fb7052234 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:17.058621 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-942afcc0-f024-46dc-9771-e42fb7052234 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-942afcc0-f024-46dc-9771-e42fb7052234 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce HTTP/1.1 Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:09:17.060361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:09:17.061938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:09:17.061938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:09:17.061938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:09:17.061938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:09:17.061938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:09:17.061938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:09:17.061938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:09:17.061938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:09:17.061938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:09:17.061938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:09:17.061938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:09:17.061938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '6372a5c9-25ed-4593-861f-78a0f8cf03ce'} Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:09:17.062873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:09:17.070241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:17.073188 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-942afcc0-f024-46dc-9771-e42fb7052234 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 404 to user: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:09:17.073188 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-942afcc0-f024-46dc-9771-e42fb7052234 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 404 len: 111 microversion: 2.1 time: 0.042940 Sep 16 08:09:17.073188 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 242/506] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:17 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:09:17.076459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6d2908bf-e34d-4e3c-a499-67e884e8778b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '.version_select at 0x7f9d06b5f550>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:17.089793 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e4d10bdf-2493-4eaa-bc27-7909a1521f98 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:17.090491 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e4d10bdf-2493-4eaa-bc27-7909a1521f98 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:17.097113 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e4d10bdf-2493-4eaa-bc27-7909a1521f98 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:17.097609 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e4d10bdf-2493-4eaa-bc27-7909a1521f98 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:17.098048 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e4d10bdf-2493-4eaa-bc27-7909a1521f98 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:17.099200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e4d10bdf-2493-4eaa-bc27-7909a1521f98 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:17.111857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e4d10bdf-2493-4eaa-bc27-7909a1521f98 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:17.111857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e4d10bdf-2493-4eaa-bc27-7909a1521f98 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:17.159863 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6d2908bf-e34d-4e3c-a499-67e884e8778b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410487216" status: 202 len: 0 microversion: 2.1 time: 0.088459 Sep 16 08:09:17.159863 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 265/507] 10.222.0.59 () {58 vars in 1221 bytes} [Fri Sep 16 08:09:17 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1410487216 => generated 0 bytes in 91 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:09:17.269301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e4d10bdf-2493-4eaa-bc27-7909a1521f98 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:17.269301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e4d10bdf-2493-4eaa-bc27-7909a1521f98 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:17.269628 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e4d10bdf-2493-4eaa-bc27-7909a1521f98 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:17.269628 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e4d10bdf-2493-4eaa-bc27-7909a1521f98 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1741 microversion: 2.20 time: 0.174484 Sep 16 08:09:17.269628 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 243/508] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:17 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1741 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:17.848650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9554e9c7-182e-46d1-8368-59541577d92f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:17.849250 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-9554e9c7-182e-46d1-8368-59541577d92f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:17.856633 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9554e9c7-182e-46d1-8368-59541577d92f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:17.857208 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9554e9c7-182e-46d1-8368-59541577d92f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:17.857857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9554e9c7-182e-46d1-8368-59541577d92f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:17.859634 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9554e9c7-182e-46d1-8368-59541577d92f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:17.860174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9554e9c7-182e-46d1-8368-59541577d92f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:17.860676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9554e9c7-182e-46d1-8368-59541577d92f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:18.037805 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-9554e9c7-182e-46d1-8368-59541577d92f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:18.048012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-76f49216-705c-455b-8d45-91d0257c06ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:18.049217 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-76f49216-705c-455b-8d45-91d0257c06ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:18.055573 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-76f49216-705c-455b-8d45-91d0257c06ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:18.060014 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9554e9c7-182e-46d1-8368-59541577d92f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.215626 Sep 16 08:09:18.063398 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 266/509] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:17 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:18.064429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-76f49216-705c-455b-8d45-91d0257c06ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:18.064917 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-76f49216-705c-455b-8d45-91d0257c06ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:18.065667 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-76f49216-705c-455b-8d45-91d0257c06ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:18.066129 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-76f49216-705c-455b-8d45-91d0257c06ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:18.067404 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-76f49216-705c-455b-8d45-91d0257c06ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:18.289399 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-74c45b80-a925-45b7-849d-50b24fbbed4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:18.290343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-74c45b80-a925-45b7-849d-50b24fbbed4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:18.295211 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-76f49216-705c-455b-8d45-91d0257c06ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:18.296422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74c45b80-a925-45b7-849d-50b24fbbed4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:18.297100 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74c45b80-a925-45b7-849d-50b24fbbed4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:18.297703 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74c45b80-a925-45b7-849d-50b24fbbed4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:18.298571 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74c45b80-a925-45b7-849d-50b24fbbed4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:18.299206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74c45b80-a925-45b7-849d-50b24fbbed4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:18.299931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74c45b80-a925-45b7-849d-50b24fbbed4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:18.308903 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-76f49216-705c-455b-8d45-91d0257c06ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1675 microversion: 2.1 time: 0.264469 Sep 16 08:09:18.324245 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 244/510] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:18 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1675 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:18.391673 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c5081966-bfb8-4bbe-856e-30965a51a525 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:18.391673 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c5081966-bfb8-4bbe-856e-30965a51a525 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:18.392246 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c5081966-bfb8-4bbe-856e-30965a51a525 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:18.392760 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c5081966-bfb8-4bbe-856e-30965a51a525 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:18.393207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c5081966-bfb8-4bbe-856e-30965a51a525 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:18.394038 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c5081966-bfb8-4bbe-856e-30965a51a525 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:18.395778 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c5081966-bfb8-4bbe-856e-30965a51a525 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:18.395778 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c5081966-bfb8-4bbe-856e-30965a51a525 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:18.481403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-74c45b80-a925-45b7-849d-50b24fbbed4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:18.485072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-c5081966-bfb8-4bbe-856e-30965a51a525 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lazy-loading 'services' on Instance uuid 547e4d8b-02bd-4033-82b3-04db0ba60fe5 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:09:18.489486 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-74c45b80-a925-45b7-849d-50b24fbbed4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:18.490380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-74c45b80-a925-45b7-849d-50b24fbbed4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:18.491578 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-74c45b80-a925-45b7-849d-50b24fbbed4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1741 microversion: 2.20 time: 0.206102 Sep 16 08:09:18.492147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 267/511] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:18 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1741 bytes in 207 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:18.681741 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c5081966-bfb8-4bbe-856e-30965a51a525 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/os-volume_attachments/17d53de9-2afe-4288-ad69-afce393e4fcd" status: 202 len: 0 microversion: 2.1 time: 0.301400 Sep 16 08:09:18.682546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 245/512] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Sep 16 08:09:18 2022] DELETE /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/os-volume_attachments/17d53de9-2afe-4288-ad69-afce393e4fcd => generated 0 bytes in 303 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 08:09:18.691035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ad7622dd-190d-44c4-9b9d-d0204a0eac71 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:18.693273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ad7622dd-190d-44c4-9b9d-d0204a0eac71 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:18.699369 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ad7622dd-190d-44c4-9b9d-d0204a0eac71 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:18.702806 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ad7622dd-190d-44c4-9b9d-d0204a0eac71 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:18.702806 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ad7622dd-190d-44c4-9b9d-d0204a0eac71 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:18.702806 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ad7622dd-190d-44c4-9b9d-d0204a0eac71 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:18.702806 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ad7622dd-190d-44c4-9b9d-d0204a0eac71 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:18.703300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ad7622dd-190d-44c4-9b9d-d0204a0eac71 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:18.732846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ad7622dd-190d-44c4-9b9d-d0204a0eac71 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045831 Sep 16 08:09:18.733406 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 268/513] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:09:18 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:09:19.086560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f7dcef8a-d196-447c-bfd9-ea5121e093de tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:19.087897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f7dcef8a-d196-447c-bfd9-ea5121e093de tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:19.094492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7dcef8a-d196-447c-bfd9-ea5121e093de tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:19.095002 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7dcef8a-d196-447c-bfd9-ea5121e093de tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:19.095433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7dcef8a-d196-447c-bfd9-ea5121e093de tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:19.096115 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7dcef8a-d196-447c-bfd9-ea5121e093de tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:19.096564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7dcef8a-d196-447c-bfd9-ea5121e093de tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:19.096985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7dcef8a-d196-447c-bfd9-ea5121e093de tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:19.237144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f7dcef8a-d196-447c-bfd9-ea5121e093de tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:19.240699 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:19.246132 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f7dcef8a-d196-447c-bfd9-ea5121e093de tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.163718 Sep 16 08:09:19.246707 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 246/514] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:19 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:19.334897 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9e5fda23-6364-4bd3-a5e1-55029b7083ac tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:19.335569 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-9e5fda23-6364-4bd3-a5e1-55029b7083ac tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:19.341896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9e5fda23-6364-4bd3-a5e1-55029b7083ac tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:19.342432 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9e5fda23-6364-4bd3-a5e1-55029b7083ac tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:19.342907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9e5fda23-6364-4bd3-a5e1-55029b7083ac tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:19.343596 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9e5fda23-6364-4bd3-a5e1-55029b7083ac tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:19.344047 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9e5fda23-6364-4bd3-a5e1-55029b7083ac tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:19.344471 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9e5fda23-6364-4bd3-a5e1-55029b7083ac tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:19.469582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-9e5fda23-6364-4bd3-a5e1-55029b7083ac tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:19.477238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9e5fda23-6364-4bd3-a5e1-55029b7083ac tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1675 microversion: 2.1 time: 0.146149 Sep 16 08:09:19.477805 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 269/515] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:19 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1675 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:19.517167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-8c53a50b-9bc6-4887-a28e-1d5e6f31c8ab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:19.517705 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-8c53a50b-9bc6-4887-a28e-1d5e6f31c8ab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:19.523978 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8c53a50b-9bc6-4887-a28e-1d5e6f31c8ab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:19.524459 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8c53a50b-9bc6-4887-a28e-1d5e6f31c8ab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:19.524895 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8c53a50b-9bc6-4887-a28e-1d5e6f31c8ab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:19.525581 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8c53a50b-9bc6-4887-a28e-1d5e6f31c8ab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:19.526032 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8c53a50b-9bc6-4887-a28e-1d5e6f31c8ab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:19.526454 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8c53a50b-9bc6-4887-a28e-1d5e6f31c8ab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:19.654533 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-8c53a50b-9bc6-4887-a28e-1d5e6f31c8ab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:19.663053 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-8c53a50b-9bc6-4887-a28e-1d5e6f31c8ab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:19.664515 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-8c53a50b-9bc6-4887-a28e-1d5e6f31c8ab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:19.666199 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-8c53a50b-9bc6-4887-a28e-1d5e6f31c8ab tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1741 microversion: 2.20 time: 0.153339 Sep 16 08:09:19.666774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 247/516] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:19 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1741 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:19.746159 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6aa32bef-4b98-4ff0-bb30-03bb7d010323 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:19.748363 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6aa32bef-4b98-4ff0-bb30-03bb7d010323 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:19.754427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6aa32bef-4b98-4ff0-bb30-03bb7d010323 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:19.754954 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6aa32bef-4b98-4ff0-bb30-03bb7d010323 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:19.755396 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6aa32bef-4b98-4ff0-bb30-03bb7d010323 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:19.756089 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6aa32bef-4b98-4ff0-bb30-03bb7d010323 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:19.756549 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6aa32bef-4b98-4ff0-bb30-03bb7d010323 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:19.756977 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6aa32bef-4b98-4ff0-bb30-03bb7d010323 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:19.786013 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6aa32bef-4b98-4ff0-bb30-03bb7d010323 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044308 Sep 16 08:09:19.786498 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 270/517] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:09:19 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:09:20.269713 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e10d4ec4-01d8-46b6-b697-7b494682cbe4 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:20.270435 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e10d4ec4-01d8-46b6-b697-7b494682cbe4 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:20.277398 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e10d4ec4-01d8-46b6-b697-7b494682cbe4 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:20.278764 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e10d4ec4-01d8-46b6-b697-7b494682cbe4 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:20.278764 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e10d4ec4-01d8-46b6-b697-7b494682cbe4 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:20.279141 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e10d4ec4-01d8-46b6-b697-7b494682cbe4 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:20.279487 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e10d4ec4-01d8-46b6-b697-7b494682cbe4 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:20.279915 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e10d4ec4-01d8-46b6-b697-7b494682cbe4 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:20.426810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e10d4ec4-01d8-46b6-b697-7b494682cbe4 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:20.436477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e10d4ec4-01d8-46b6-b697-7b494682cbe4 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.170858 Sep 16 08:09:20.437059 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 248/518] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:20 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:20.500292 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-aa3f5c83-673c-42a6-9b61-e0b83f869b4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:20.500910 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-aa3f5c83-673c-42a6-9b61-e0b83f869b4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:20.507743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-aa3f5c83-673c-42a6-9b61-e0b83f869b4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:20.508340 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-aa3f5c83-673c-42a6-9b61-e0b83f869b4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:20.509279 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-aa3f5c83-673c-42a6-9b61-e0b83f869b4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:20.510061 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-aa3f5c83-673c-42a6-9b61-e0b83f869b4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:20.510577 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-aa3f5c83-673c-42a6-9b61-e0b83f869b4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:20.511070 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-aa3f5c83-673c-42a6-9b61-e0b83f869b4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:20.692657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-aa3f5c83-673c-42a6-9b61-e0b83f869b4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:20.693358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6568f2cf-d317-4fb8-9d70-1ee82620eae3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:20.693977 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6568f2cf-d317-4fb8-9d70-1ee82620eae3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:20.700428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6568f2cf-d317-4fb8-9d70-1ee82620eae3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:20.700913 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6568f2cf-d317-4fb8-9d70-1ee82620eae3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:20.701079 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-aa3f5c83-673c-42a6-9b61-e0b83f869b4f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1675 microversion: 2.1 time: 0.204655 Sep 16 08:09:20.701355 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6568f2cf-d317-4fb8-9d70-1ee82620eae3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:20.701824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 271/519] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:20 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1675 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:20.702090 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6568f2cf-d317-4fb8-9d70-1ee82620eae3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:20.702545 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6568f2cf-d317-4fb8-9d70-1ee82620eae3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:20.703005 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6568f2cf-d317-4fb8-9d70-1ee82620eae3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:20.800555 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9fd16e82-7ba7-4673-aeac-a56e2d350326 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:20.802703 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-9fd16e82-7ba7-4673-aeac-a56e2d350326 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:20.809181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9fd16e82-7ba7-4673-aeac-a56e2d350326 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:20.812380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9fd16e82-7ba7-4673-aeac-a56e2d350326 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:20.812380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9fd16e82-7ba7-4673-aeac-a56e2d350326 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:20.812380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9fd16e82-7ba7-4673-aeac-a56e2d350326 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:20.812380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9fd16e82-7ba7-4673-aeac-a56e2d350326 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:20.812703 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9fd16e82-7ba7-4673-aeac-a56e2d350326 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:20.833631 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6568f2cf-d317-4fb8-9d70-1ee82620eae3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:20.841286 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9fd16e82-7ba7-4673-aeac-a56e2d350326 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044734 Sep 16 08:09:20.841938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 272/520] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:09:20 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 08:09:20.842112 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6568f2cf-d317-4fb8-9d70-1ee82620eae3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:20.843557 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6568f2cf-d317-4fb8-9d70-1ee82620eae3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:20.844712 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6568f2cf-d317-4fb8-9d70-1ee82620eae3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1723 microversion: 2.20 time: 0.155867 Sep 16 08:09:20.845314 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 249/521] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:20 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:20.904617 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c014bfbf-3b71-450b-9d2a-2d04b7a8c0a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:20.905145 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c014bfbf-3b71-450b-9d2a-2d04b7a8c0a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:20.911361 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c014bfbf-3b71-450b-9d2a-2d04b7a8c0a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:20.911844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c014bfbf-3b71-450b-9d2a-2d04b7a8c0a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:20.912283 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c014bfbf-3b71-450b-9d2a-2d04b7a8c0a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:20.912975 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c014bfbf-3b71-450b-9d2a-2d04b7a8c0a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:20.913458 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c014bfbf-3b71-450b-9d2a-2d04b7a8c0a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:20.913885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c014bfbf-3b71-450b-9d2a-2d04b7a8c0a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:20.938167 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c014bfbf-3b71-450b-9d2a-2d04b7a8c0a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:09:21.201480 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c014bfbf-3b71-450b-9d2a-2d04b7a8c0a5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 204 len: 0 microversion: 2.1 time: 0.300564 Sep 16 08:09:21.202062 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 273/522] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:09:20 2022] DELETE /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 0 bytes in 302 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:09:21.210111 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3dafe247-7e77-4cda-babc-a90a8ef5cfed tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:21.210746 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3dafe247-7e77-4cda-babc-a90a8ef5cfed tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:21.217430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3dafe247-7e77-4cda-babc-a90a8ef5cfed tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:21.217910 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3dafe247-7e77-4cda-babc-a90a8ef5cfed tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:21.218348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3dafe247-7e77-4cda-babc-a90a8ef5cfed tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:21.219072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3dafe247-7e77-4cda-babc-a90a8ef5cfed tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:21.219543 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3dafe247-7e77-4cda-babc-a90a8ef5cfed tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:21.219955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3dafe247-7e77-4cda-babc-a90a8ef5cfed tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:21.349023 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3dafe247-7e77-4cda-babc-a90a8ef5cfed tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:21.357002 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3dafe247-7e77-4cda-babc-a90a8ef5cfed tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1678 microversion: 2.1 time: 0.150676 Sep 16 08:09:21.357575 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 250/523] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:21 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1678 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:21.461041 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-213d3dd4-003e-4a45-b5d4-ef42f0afc29a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:21.461841 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-213d3dd4-003e-4a45-b5d4-ef42f0afc29a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:21.468422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-213d3dd4-003e-4a45-b5d4-ef42f0afc29a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:21.468972 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-213d3dd4-003e-4a45-b5d4-ef42f0afc29a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:21.469479 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-213d3dd4-003e-4a45-b5d4-ef42f0afc29a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:21.470213 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-213d3dd4-003e-4a45-b5d4-ef42f0afc29a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:21.470669 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-213d3dd4-003e-4a45-b5d4-ef42f0afc29a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:21.471121 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-213d3dd4-003e-4a45-b5d4-ef42f0afc29a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:21.475191 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:21.615957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-213d3dd4-003e-4a45-b5d4-ef42f0afc29a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:21.624361 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-213d3dd4-003e-4a45-b5d4-ef42f0afc29a tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.167704 Sep 16 08:09:21.624920 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 274/524] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:21 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:21.724576 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c79fe322-ba18-43eb-b5f3-83972c48ab58 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:21.725114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c79fe322-ba18-43eb-b5f3-83972c48ab58 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:21.731261 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c79fe322-ba18-43eb-b5f3-83972c48ab58 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:21.731745 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c79fe322-ba18-43eb-b5f3-83972c48ab58 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:21.732185 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c79fe322-ba18-43eb-b5f3-83972c48ab58 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:21.732874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c79fe322-ba18-43eb-b5f3-83972c48ab58 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:21.733332 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c79fe322-ba18-43eb-b5f3-83972c48ab58 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:21.733762 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c79fe322-ba18-43eb-b5f3-83972c48ab58 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:21.861543 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c79fe322-ba18-43eb-b5f3-83972c48ab58 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:21.869830 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c79fe322-ba18-43eb-b5f3-83972c48ab58 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1675 microversion: 2.1 time: 0.149241 Sep 16 08:09:21.870398 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 251/525] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:21 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1675 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:21.872509 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-72234ef6-391b-4521-8f64-3d24d8e0b1cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:21.873195 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-72234ef6-391b-4521-8f64-3d24d8e0b1cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:21.879649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-72234ef6-391b-4521-8f64-3d24d8e0b1cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:21.880125 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-72234ef6-391b-4521-8f64-3d24d8e0b1cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:21.880555 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-72234ef6-391b-4521-8f64-3d24d8e0b1cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:21.881236 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-72234ef6-391b-4521-8f64-3d24d8e0b1cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:21.881689 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-72234ef6-391b-4521-8f64-3d24d8e0b1cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:21.882110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-72234ef6-391b-4521-8f64-3d24d8e0b1cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:21.891273 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d16d79e6-8edc-412a-aad5-636529504725 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "b6cc13a8-8428-4403-ae39-f49efdfcbcf3"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:21.897263 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d16d79e6-8edc-412a-aad5-636529504725 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:21.900033 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d16d79e6-8edc-412a-aad5-636529504725 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:21.900514 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d16d79e6-8edc-412a-aad5-636529504725 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:21.900951 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d16d79e6-8edc-412a-aad5-636529504725 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:21.901636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d16d79e6-8edc-412a-aad5-636529504725 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:21.902184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d16d79e6-8edc-412a-aad5-636529504725 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:21.902605 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d16d79e6-8edc-412a-aad5-636529504725 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:22.012795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-72234ef6-391b-4521-8f64-3d24d8e0b1cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:22.020813 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-72234ef6-391b-4521-8f64-3d24d8e0b1cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:22.022247 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-72234ef6-391b-4521-8f64-3d24d8e0b1cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:22.023429 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-72234ef6-391b-4521-8f64-3d24d8e0b1cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1723 microversion: 2.20 time: 0.155528 Sep 16 08:09:22.023979 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 275/526] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:21 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1723 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:22.380323 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-68cec779-80fb-4dfa-8019-604ab7a759bb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:22.380850 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-68cec779-80fb-4dfa-8019-604ab7a759bb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:22.386742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68cec779-80fb-4dfa-8019-604ab7a759bb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:22.387225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68cec779-80fb-4dfa-8019-604ab7a759bb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:22.387660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68cec779-80fb-4dfa-8019-604ab7a759bb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:22.388344 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68cec779-80fb-4dfa-8019-604ab7a759bb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:22.388793 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68cec779-80fb-4dfa-8019-604ab7a759bb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:22.389209 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68cec779-80fb-4dfa-8019-604ab7a759bb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:22.518225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-68cec779-80fb-4dfa-8019-604ab7a759bb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:22.526606 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-68cec779-80fb-4dfa-8019-604ab7a759bb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1678 microversion: 2.1 time: 0.150201 Sep 16 08:09:22.527201 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 276/527] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:22 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:22.648046 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f6936673-5ecb-4a35-913e-91965beff93e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:22.648636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f6936673-5ecb-4a35-913e-91965beff93e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:22.655223 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f6936673-5ecb-4a35-913e-91965beff93e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:22.655978 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f6936673-5ecb-4a35-913e-91965beff93e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:22.657433 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f6936673-5ecb-4a35-913e-91965beff93e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:22.657433 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f6936673-5ecb-4a35-913e-91965beff93e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:22.657644 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f6936673-5ecb-4a35-913e-91965beff93e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:22.657967 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f6936673-5ecb-4a35-913e-91965beff93e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:22.799900 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f6936673-5ecb-4a35-913e-91965beff93e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:22.808061 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f6936673-5ecb-4a35-913e-91965beff93e tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.163952 Sep 16 08:09:22.808623 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 277/528] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:22 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:22.894913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b2f3fdd1-a310-48c1-b124-c396d7f860fa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:22.895524 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b2f3fdd1-a310-48c1-b124-c396d7f860fa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:22.902173 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b2f3fdd1-a310-48c1-b124-c396d7f860fa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:22.902605 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b2f3fdd1-a310-48c1-b124-c396d7f860fa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:22.903070 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b2f3fdd1-a310-48c1-b124-c396d7f860fa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:22.903771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b2f3fdd1-a310-48c1-b124-c396d7f860fa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:22.904221 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b2f3fdd1-a310-48c1-b124-c396d7f860fa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:22.904647 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b2f3fdd1-a310-48c1-b124-c396d7f860fa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:23.032696 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b2f3fdd1-a310-48c1-b124-c396d7f860fa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:23.040453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b2f3fdd1-a310-48c1-b124-c396d7f860fa tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1675 microversion: 2.1 time: 0.149545 Sep 16 08:09:23.041037 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 278/529] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:22 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1675 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:23.045348 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-fb969ec9-f3e8-4fd1-b826-30f4a2d41954 req-3a54425a-9097-4867-aa8c-360d2c9293c8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c", "name": "network-vif-unplugged", "status": "completed", "tag": "0104ad2b-b1c9-455f-a512-cdc1dd34408e"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:23.054634 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-fb969ec9-f3e8-4fd1-b826-30f4a2d41954 req-3a54425a-9097-4867-aa8c-360d2c9293c8 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:23.055146 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-fb969ec9-f3e8-4fd1-b826-30f4a2d41954 req-3a54425a-9097-4867-aa8c-360d2c9293c8 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:23.060651 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-fb969ec9-f3e8-4fd1-b826-30f4a2d41954 req-3a54425a-9097-4867-aa8c-360d2c9293c8 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:23.067362 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-fb969ec9-f3e8-4fd1-b826-30f4a2d41954 req-3a54425a-9097-4867-aa8c-360d2c9293c8 service nova] Creating event network-vif-unplugged:0104ad2b-b1c9-455f-a512-cdc1dd34408e for instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c on hv-cinder-74014 Sep 16 08:09:23.072929 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-fb969ec9-f3e8-4fd1-b826-30f4a2d41954 req-3a54425a-9097-4867-aa8c-360d2c9293c8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030850 Sep 16 08:09:23.073514 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 279/530] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:09:23 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:09:23.078515 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5a95da2b-4f17-430e-9dba-85cac8ff6042 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:23.079178 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5a95da2b-4f17-430e-9dba-85cac8ff6042 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:23.085086 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5a95da2b-4f17-430e-9dba-85cac8ff6042 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:23.085573 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5a95da2b-4f17-430e-9dba-85cac8ff6042 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:23.086011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5a95da2b-4f17-430e-9dba-85cac8ff6042 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:23.086716 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5a95da2b-4f17-430e-9dba-85cac8ff6042 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:23.087223 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5a95da2b-4f17-430e-9dba-85cac8ff6042 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:23.090779 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5a95da2b-4f17-430e-9dba-85cac8ff6042 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:23.220878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5a95da2b-4f17-430e-9dba-85cac8ff6042 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:23.228950 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5a95da2b-4f17-430e-9dba-85cac8ff6042 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:23.230397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5a95da2b-4f17-430e-9dba-85cac8ff6042 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:23.231580 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5a95da2b-4f17-430e-9dba-85cac8ff6042 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1723 microversion: 2.20 time: 0.157021 Sep 16 08:09:23.232138 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 280/531] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:23 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1723 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:23.550502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dee767e1-bbfe-4c15-9306-fac3c4db6987 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:23.551139 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dee767e1-bbfe-4c15-9306-fac3c4db6987 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:23.558044 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dee767e1-bbfe-4c15-9306-fac3c4db6987 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:23.558526 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dee767e1-bbfe-4c15-9306-fac3c4db6987 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:23.558990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dee767e1-bbfe-4c15-9306-fac3c4db6987 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:23.559675 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dee767e1-bbfe-4c15-9306-fac3c4db6987 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:23.560128 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dee767e1-bbfe-4c15-9306-fac3c4db6987 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:23.560549 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dee767e1-bbfe-4c15-9306-fac3c4db6987 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:23.686645 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dee767e1-bbfe-4c15-9306-fac3c4db6987 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:23.696348 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dee767e1-bbfe-4c15-9306-fac3c4db6987 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1678 microversion: 2.1 time: 0.149579 Sep 16 08:09:23.696923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 281/532] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:23 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1678 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:23.831773 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-fb2228aa-5810-4adf-83ce-bcc9c0556c51 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:23.832310 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-fb2228aa-5810-4adf-83ce-bcc9c0556c51 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:23.838743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fb2228aa-5810-4adf-83ce-bcc9c0556c51 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:23.839221 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fb2228aa-5810-4adf-83ce-bcc9c0556c51 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:23.839649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fb2228aa-5810-4adf-83ce-bcc9c0556c51 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:23.840331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fb2228aa-5810-4adf-83ce-bcc9c0556c51 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:23.840846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fb2228aa-5810-4adf-83ce-bcc9c0556c51 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:23.841270 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fb2228aa-5810-4adf-83ce-bcc9c0556c51 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:23.981669 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-fb2228aa-5810-4adf-83ce-bcc9c0556c51 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:23.989924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-fb2228aa-5810-4adf-83ce-bcc9c0556c51 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1755 microversion: 2.1 time: 0.162108 Sep 16 08:09:23.990488 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 282/533] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:23 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1755 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:24.063526 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5c0c94ff-c388-4abd-b11e-49de8884ec39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:24.064126 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5c0c94ff-c388-4abd-b11e-49de8884ec39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:24.069691 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5c0c94ff-c388-4abd-b11e-49de8884ec39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:24.070174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5c0c94ff-c388-4abd-b11e-49de8884ec39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:24.070606 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5c0c94ff-c388-4abd-b11e-49de8884ec39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:24.071322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5c0c94ff-c388-4abd-b11e-49de8884ec39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:24.071777 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5c0c94ff-c388-4abd-b11e-49de8884ec39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:24.072198 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5c0c94ff-c388-4abd-b11e-49de8884ec39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:24.203429 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5c0c94ff-c388-4abd-b11e-49de8884ec39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:24.211110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5c0c94ff-c388-4abd-b11e-49de8884ec39 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1675 microversion: 2.1 time: 0.151077 Sep 16 08:09:24.211675 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 283/534] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:24 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1675 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:24.257055 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d9b4c05f-5acb-4bb6-a15a-e98fe368f8f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:24.257655 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d9b4c05f-5acb-4bb6-a15a-e98fe368f8f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:24.264224 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d9b4c05f-5acb-4bb6-a15a-e98fe368f8f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:24.264711 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d9b4c05f-5acb-4bb6-a15a-e98fe368f8f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:24.265148 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d9b4c05f-5acb-4bb6-a15a-e98fe368f8f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:24.265884 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d9b4c05f-5acb-4bb6-a15a-e98fe368f8f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:24.266340 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d9b4c05f-5acb-4bb6-a15a-e98fe368f8f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:24.266792 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d9b4c05f-5acb-4bb6-a15a-e98fe368f8f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:24.402349 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d9b4c05f-5acb-4bb6-a15a-e98fe368f8f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:24.410789 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d9b4c05f-5acb-4bb6-a15a-e98fe368f8f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:24.412240 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d9b4c05f-5acb-4bb6-a15a-e98fe368f8f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:24.413400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d9b4c05f-5acb-4bb6-a15a-e98fe368f8f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1723 microversion: 2.20 time: 0.160230 Sep 16 08:09:24.413959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 284/535] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:24 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1723 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:24.719483 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1f7b088f-47c7-4e76-b227-092b257a2dd2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:24.720174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1f7b088f-47c7-4e76-b227-092b257a2dd2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:24.726872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1f7b088f-47c7-4e76-b227-092b257a2dd2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:24.727457 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1f7b088f-47c7-4e76-b227-092b257a2dd2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:24.727902 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1f7b088f-47c7-4e76-b227-092b257a2dd2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:24.728616 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1f7b088f-47c7-4e76-b227-092b257a2dd2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:24.729079 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1f7b088f-47c7-4e76-b227-092b257a2dd2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:24.729509 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1f7b088f-47c7-4e76-b227-092b257a2dd2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:24.865355 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1f7b088f-47c7-4e76-b227-092b257a2dd2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:24.873767 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1f7b088f-47c7-4e76-b227-092b257a2dd2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1678 microversion: 2.1 time: 0.158183 Sep 16 08:09:24.874327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 285/536] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:24 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1678 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:25.012411 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b12116fd-74aa-485a-9800-94bb4cf3b94f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:25.012979 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b12116fd-74aa-485a-9800-94bb4cf3b94f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:25.019081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b12116fd-74aa-485a-9800-94bb4cf3b94f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:25.019644 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b12116fd-74aa-485a-9800-94bb4cf3b94f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:25.020086 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b12116fd-74aa-485a-9800-94bb4cf3b94f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:25.020781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b12116fd-74aa-485a-9800-94bb4cf3b94f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:25.021242 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b12116fd-74aa-485a-9800-94bb4cf3b94f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:25.021667 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b12116fd-74aa-485a-9800-94bb4cf3b94f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:25.170437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b12116fd-74aa-485a-9800-94bb4cf3b94f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:25.178929 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b12116fd-74aa-485a-9800-94bb4cf3b94f tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1758 microversion: 2.1 time: 0.170429 Sep 16 08:09:25.179495 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 286/537] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:25 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1758 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:25.235061 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7688bffa-a086-41df-a30c-8c23069e6861 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:25.235789 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7688bffa-a086-41df-a30c-8c23069e6861 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:25.241554 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7688bffa-a086-41df-a30c-8c23069e6861 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:25.242043 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7688bffa-a086-41df-a30c-8c23069e6861 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:25.242486 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7688bffa-a086-41df-a30c-8c23069e6861 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:25.243234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7688bffa-a086-41df-a30c-8c23069e6861 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:25.244282 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7688bffa-a086-41df-a30c-8c23069e6861 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:25.244711 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7688bffa-a086-41df-a30c-8c23069e6861 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:25.371771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7688bffa-a086-41df-a30c-8c23069e6861 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:25.379574 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7688bffa-a086-41df-a30c-8c23069e6861 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1652 microversion: 2.1 time: 0.148298 Sep 16 08:09:25.380131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 287/538] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:25 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1652 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:25.402965 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f581f8b3-c4c8-4abd-881b-17e730f06df8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Action: 'action', calling method: >, body: {"os-start": {}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:25.409095 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f581f8b3-c4c8-4abd-881b-17e730f06df8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:25.409587 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f581f8b3-c4c8-4abd-881b-17e730f06df8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:25.410031 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f581f8b3-c4c8-4abd-881b-17e730f06df8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:25.432377 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f581f8b3-c4c8-4abd-881b-17e730f06df8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Going to try to start instance {{(pid=121046) start /opt/stack/nova/nova/compute/api.py:2785}} Sep 16 08:09:25.542364 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d16d79e6-8edc-412a-aad5-636529504725 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "POST /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 3.654744 Sep 16 08:09:25.543397 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 252/539] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:09:21 2022] POST /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments => generated 194 bytes in 3657 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:09:25.549319 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2fa8b95f-1153-4939-b9cd-be551c504de3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:25.550013 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2fa8b95f-1153-4939-b9cd-be551c504de3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:25.556415 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2fa8b95f-1153-4939-b9cd-be551c504de3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:25.556911 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2fa8b95f-1153-4939-b9cd-be551c504de3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:25.557334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2fa8b95f-1153-4939-b9cd-be551c504de3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:25.558202 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2fa8b95f-1153-4939-b9cd-be551c504de3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:25.558663 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2fa8b95f-1153-4939-b9cd-be551c504de3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:25.559114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2fa8b95f-1153-4939-b9cd-be551c504de3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:25.608342 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f581f8b3-c4c8-4abd-881b-17e730f06df8 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "POST /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/action" status: 202 len: 0 microversion: 2.1 time: 0.208723 Sep 16 08:09:25.612151 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 288/540] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:09:25 2022] POST /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/action => generated 0 bytes in 211 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:09:25.621250 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-86e4bc5b-0a21-4690-9927-c0dbbb1c20ad tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:25.622352 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-86e4bc5b-0a21-4690-9927-c0dbbb1c20ad tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:25.639787 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-86e4bc5b-0a21-4690-9927-c0dbbb1c20ad tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:25.641925 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-86e4bc5b-0a21-4690-9927-c0dbbb1c20ad tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:25.645390 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-86e4bc5b-0a21-4690-9927-c0dbbb1c20ad tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:25.646379 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-86e4bc5b-0a21-4690-9927-c0dbbb1c20ad tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:25.648004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-86e4bc5b-0a21-4690-9927-c0dbbb1c20ad tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:25.649076 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-86e4bc5b-0a21-4690-9927-c0dbbb1c20ad tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:25.823561 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2fa8b95f-1153-4939-b9cd-be551c504de3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:25.833006 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2fa8b95f-1153-4939-b9cd-be551c504de3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:25.834496 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2fa8b95f-1153-4939-b9cd-be551c504de3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:25.835731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2fa8b95f-1153-4939-b9cd-be551c504de3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1726 microversion: 2.20 time: 0.291128 Sep 16 08:09:25.836285 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 253/541] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:25 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1726 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:25.861196 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f7563207-4669-4762-9b26-8b98405d0c5a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "7aba4e65-c67a-45e1-af7c-4a3569a2817b"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:25.863548 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f7563207-4669-4762-9b26-8b98405d0c5a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:25.869953 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7563207-4669-4762-9b26-8b98405d0c5a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:25.870441 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7563207-4669-4762-9b26-8b98405d0c5a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:25.870905 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7563207-4669-4762-9b26-8b98405d0c5a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:25.871608 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7563207-4669-4762-9b26-8b98405d0c5a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:25.872056 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7563207-4669-4762-9b26-8b98405d0c5a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:25.872477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f7563207-4669-4762-9b26-8b98405d0c5a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:26.107667 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-86e4bc5b-0a21-4690-9927-c0dbbb1c20ad tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:26.116339 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-86e4bc5b-0a21-4690-9927-c0dbbb1c20ad tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1661 microversion: 2.1 time: 0.501855 Sep 16 08:09:26.116837 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 289/542] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:25 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1661 bytes in 504 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:26.121959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-925a51ec-2205-4e74-853c-df16b59b1775 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:26.122614 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-925a51ec-2205-4e74-853c-df16b59b1775 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:26.128625 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-925a51ec-2205-4e74-853c-df16b59b1775 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:26.129242 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-925a51ec-2205-4e74-853c-df16b59b1775 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:26.129793 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-925a51ec-2205-4e74-853c-df16b59b1775 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:26.130602 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-925a51ec-2205-4e74-853c-df16b59b1775 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:26.131205 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-925a51ec-2205-4e74-853c-df16b59b1775 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:26.131737 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-925a51ec-2205-4e74-853c-df16b59b1775 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:26.156176 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:26.383801 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-925a51ec-2205-4e74-853c-df16b59b1775 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:26.393944 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-925a51ec-2205-4e74-853c-df16b59b1775 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1678 microversion: 2.1 time: 0.275961 Sep 16 08:09:26.406030 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 290/543] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:26 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1678 bytes in 288 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:26.879249 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-cf1c085b-41ef-46fa-afef-deffa5c4f884 req-7648ec56-037b-4e33-a446-9cb0235a70b8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "547e4d8b-02bd-4033-82b3-04db0ba60fe5", "name": "network-vif-deleted", "tag": "047136d4-f91b-4e74-bfe8-7505cf1c706e"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:26.889394 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-cf1c085b-41ef-46fa-afef-deffa5c4f884 req-7648ec56-037b-4e33-a446-9cb0235a70b8 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:26.889994 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-cf1c085b-41ef-46fa-afef-deffa5c4f884 req-7648ec56-037b-4e33-a446-9cb0235a70b8 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:26.891815 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-cf1c085b-41ef-46fa-afef-deffa5c4f884 req-7648ec56-037b-4e33-a446-9cb0235a70b8 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:26.902232 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-cf1c085b-41ef-46fa-afef-deffa5c4f884 req-7648ec56-037b-4e33-a446-9cb0235a70b8 service nova] Creating event network-vif-deleted:047136d4-f91b-4e74-bfe8-7505cf1c706e for instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 on hv-cinder-74014 Sep 16 08:09:26.907277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-cf1c085b-41ef-46fa-afef-deffa5c4f884 req-7648ec56-037b-4e33-a446-9cb0235a70b8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031805 Sep 16 08:09:26.908200 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 291/544] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:09:26 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:09:27.115033 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f7563207-4669-4762-9b26-8b98405d0c5a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "POST /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.257752 Sep 16 08:09:27.116045 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 254/545] 10.222.0.59 () {62 vars in 1364 bytes} [Fri Sep 16 08:09:25 2022] POST /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-volume_attachments => generated 188 bytes in 1260 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 08:09:27.142800 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-baa45233-9008-4cd3-9c28-19543c60a0b3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:27.143520 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-baa45233-9008-4cd3-9c28-19543c60a0b3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:27.154021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-baa45233-9008-4cd3-9c28-19543c60a0b3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:27.154528 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-baa45233-9008-4cd3-9c28-19543c60a0b3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:27.154996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-baa45233-9008-4cd3-9c28-19543c60a0b3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:27.155966 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-baa45233-9008-4cd3-9c28-19543c60a0b3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:27.156423 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-baa45233-9008-4cd3-9c28-19543c60a0b3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:27.157175 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-baa45233-9008-4cd3-9c28-19543c60a0b3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:27.265388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f2ec1f67-b572-488b-853e-94c29c025d18 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:27.266084 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f2ec1f67-b572-488b-853e-94c29c025d18 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:27.278510 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2ec1f67-b572-488b-853e-94c29c025d18 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:27.280883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2ec1f67-b572-488b-853e-94c29c025d18 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:27.283312 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2ec1f67-b572-488b-853e-94c29c025d18 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:27.285236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2ec1f67-b572-488b-853e-94c29c025d18 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:27.286088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2ec1f67-b572-488b-853e-94c29c025d18 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:27.286795 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2ec1f67-b572-488b-853e-94c29c025d18 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:27.328898 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-baa45233-9008-4cd3-9c28-19543c60a0b3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:27.338705 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-baa45233-9008-4cd3-9c28-19543c60a0b3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1661 microversion: 2.1 time: 0.201585 Sep 16 08:09:27.356623 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 292/546] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:27 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1661 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:27.361767 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f2ec1f67-b572-488b-853e-94c29c025d18 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121047) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 08:09:27.422074 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:27.422793 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:27.436959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:27.436959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:27.436959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:27.436959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:27.437452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:27.437452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:27.499672 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:27.501616 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:27.502253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:27.505376 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lazy-loading 'fault' on Instance uuid 547e4d8b-02bd-4033-82b3-04db0ba60fe5 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:09:27.578416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:27.587313 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-67b1fd28-d89e-4428-835c-f3046d2e71ba tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1330 microversion: 2.1 time: 0.173085 Sep 16 08:09:27.588551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 293/547] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:27 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1330 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:27.676493 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f2ec1f67-b572-488b-853e-94c29c025d18 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "POST /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/action" status: 202 len: 0 microversion: 2.20 time: 0.419433 Sep 16 08:09:27.677744 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 255/548] 10.222.0.59 () {62 vars in 1319 bytes} [Fri Sep 16 08:09:27 2022] POST /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/action => generated 0 bytes in 421 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 08:09:27.685729 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-eb3fff8a-7f7d-4c7a-8276-924b1a1dfdd5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:27.687206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-eb3fff8a-7f7d-4c7a-8276-924b1a1dfdd5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:27.688945 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=97,nova_api:UPDATE=2,nova_api:DELETE=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:27.693116 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb3fff8a-7f7d-4c7a-8276-924b1a1dfdd5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:27.693833 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb3fff8a-7f7d-4c7a-8276-924b1a1dfdd5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:27.694275 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb3fff8a-7f7d-4c7a-8276-924b1a1dfdd5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:27.695181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb3fff8a-7f7d-4c7a-8276-924b1a1dfdd5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:27.695643 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb3fff8a-7f7d-4c7a-8276-924b1a1dfdd5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:27.696262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb3fff8a-7f7d-4c7a-8276-924b1a1dfdd5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:27.866226 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-eb3fff8a-7f7d-4c7a-8276-924b1a1dfdd5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:27.879782 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-eb3fff8a-7f7d-4c7a-8276-924b1a1dfdd5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:27.883729 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-eb3fff8a-7f7d-4c7a-8276-924b1a1dfdd5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:27.885301 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-eb3fff8a-7f7d-4c7a-8276-924b1a1dfdd5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1752 microversion: 2.20 time: 0.203371 Sep 16 08:09:27.886526 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 294/549] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:27 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1752 bytes in 205 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:28.362603 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e889c1bb-5c70-412b-9dab-3ab499fbbcab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:28.363331 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e889c1bb-5c70-412b-9dab-3ab499fbbcab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:28.369740 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e889c1bb-5c70-412b-9dab-3ab499fbbcab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:28.370228 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e889c1bb-5c70-412b-9dab-3ab499fbbcab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:28.370662 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e889c1bb-5c70-412b-9dab-3ab499fbbcab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:28.371513 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e889c1bb-5c70-412b-9dab-3ab499fbbcab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:28.371965 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e889c1bb-5c70-412b-9dab-3ab499fbbcab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:28.372387 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e889c1bb-5c70-412b-9dab-3ab499fbbcab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:28.507935 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e889c1bb-5c70-412b-9dab-3ab499fbbcab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:28.515754 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e889c1bb-5c70-412b-9dab-3ab499fbbcab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1661 microversion: 2.1 time: 0.157675 Sep 16 08:09:28.516318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 256/550] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:28 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1661 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:28.609832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:28.610522 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:28.617131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:28.617688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:28.618244 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:28.619028 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:28.619707 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:28.620203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:28.651591 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:28.652075 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:28.652506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:28.652952 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lazy-loading 'fault' on Instance uuid 547e4d8b-02bd-4033-82b3-04db0ba60fe5 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:09:28.694786 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:28.703574 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-26288220-e728-4da3-a3ae-0b849136b520 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 200 len: 1330 microversion: 2.1 time: 0.097279 Sep 16 08:09:28.704190 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 295/551] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:28 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 1330 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:28.911925 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-710e5cd2-a65e-4db9-a012-b26568af3b6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:28.913001 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-710e5cd2-a65e-4db9-a012-b26568af3b6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:28.921236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-710e5cd2-a65e-4db9-a012-b26568af3b6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:28.922330 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-710e5cd2-a65e-4db9-a012-b26568af3b6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:28.922429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-710e5cd2-a65e-4db9-a012-b26568af3b6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:28.923114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-710e5cd2-a65e-4db9-a012-b26568af3b6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:28.923595 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-710e5cd2-a65e-4db9-a012-b26568af3b6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:28.924031 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-710e5cd2-a65e-4db9-a012-b26568af3b6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:29.053499 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-710e5cd2-a65e-4db9-a012-b26568af3b6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:29.062709 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-710e5cd2-a65e-4db9-a012-b26568af3b6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:29.064141 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-710e5cd2-a65e-4db9-a012-b26568af3b6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:29.065293 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-710e5cd2-a65e-4db9-a012-b26568af3b6d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1752 microversion: 2.20 time: 0.157494 Sep 16 08:09:29.065848 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 257/552] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:28 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1752 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:29.538874 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f0294804-bc56-4a31-aa3f-3795aa817528 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:29.539487 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f0294804-bc56-4a31-aa3f-3795aa817528 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:29.545938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f0294804-bc56-4a31-aa3f-3795aa817528 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:29.546426 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f0294804-bc56-4a31-aa3f-3795aa817528 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:29.546911 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f0294804-bc56-4a31-aa3f-3795aa817528 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:29.547602 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f0294804-bc56-4a31-aa3f-3795aa817528 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:29.548068 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f0294804-bc56-4a31-aa3f-3795aa817528 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:29.548496 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f0294804-bc56-4a31-aa3f-3795aa817528 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:29.676069 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f0294804-bc56-4a31-aa3f-3795aa817528 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:29.684303 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f0294804-bc56-4a31-aa3f-3795aa817528 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1665 microversion: 2.1 time: 0.149333 Sep 16 08:09:29.685184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 296/553] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:29 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1665 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:29.726701 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d00902e2-b335-4574-b49a-3cf3a10bd904 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:29.727391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d00902e2-b335-4574-b49a-3cf3a10bd904 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:29.734428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d00902e2-b335-4574-b49a-3cf3a10bd904 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:29.734943 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d00902e2-b335-4574-b49a-3cf3a10bd904 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:29.735384 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d00902e2-b335-4574-b49a-3cf3a10bd904 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:29.736072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d00902e2-b335-4574-b49a-3cf3a10bd904 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:29.736525 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d00902e2-b335-4574-b49a-3cf3a10bd904 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:29.736953 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d00902e2-b335-4574-b49a-3cf3a10bd904 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:29.750763 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-d00902e2-b335-4574-b49a-3cf3a10bd904 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d00902e2-b335-4574-b49a-3cf3a10bd904 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 HTTP/1.1 Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:09:29.752388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:09:29.753929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:09:29.753929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:09:29.753929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:09:29.753929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:09:29.753929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:09:29.753929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:09:29.753929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:09:29.753929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:09:29.753929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:09:29.753929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:09:29.753929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:09:29.753929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '547e4d8b-02bd-4033-82b3-04db0ba60fe5'} Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:09:29.754914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:09:29.756416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:09:29.757823 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d00902e2-b335-4574-b49a-3cf3a10bd904 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 404 to user: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:09:29.757823 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d00902e2-b335-4574-b49a-3cf3a10bd904 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 404 len: 111 microversion: 2.1 time: 0.031011 Sep 16 08:09:29.757823 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 258/554] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:29 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:09:29.762637 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-52b79f11-c175-41ab-9123-05c911f482c6 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '.version_select at 0x7f9d06ab6430>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:29.830929 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-52b79f11-c175-41ab-9123-05c911f482c6 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-750192348" status: 202 len: 0 microversion: 2.1 time: 0.072073 Sep 16 08:09:29.831406 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 297/555] 10.222.0.59 () {58 vars in 1218 bytes} [Fri Sep 16 08:09:29 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-750192348 => generated 0 bytes in 73 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:09:30.091379 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d23a4820-f914-4431-b1d3-1ee1234cfd29 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:30.092000 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d23a4820-f914-4431-b1d3-1ee1234cfd29 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:30.098030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d23a4820-f914-4431-b1d3-1ee1234cfd29 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:30.098567 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d23a4820-f914-4431-b1d3-1ee1234cfd29 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:30.105473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d23a4820-f914-4431-b1d3-1ee1234cfd29 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:30.105473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d23a4820-f914-4431-b1d3-1ee1234cfd29 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:30.105473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d23a4820-f914-4431-b1d3-1ee1234cfd29 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:30.105473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d23a4820-f914-4431-b1d3-1ee1234cfd29 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:30.106076 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=88,nova_cell1:UPDATE=7,nova_cell1:INSERT=5 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:30.228558 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d23a4820-f914-4431-b1d3-1ee1234cfd29 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:30.237026 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d23a4820-f914-4431-b1d3-1ee1234cfd29 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:30.238511 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d23a4820-f914-4431-b1d3-1ee1234cfd29 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:30.239684 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d23a4820-f914-4431-b1d3-1ee1234cfd29 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1754 microversion: 2.20 time: 0.153018 Sep 16 08:09:30.240229 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 259/556] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:30 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1754 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:30.610250 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f3a4b808-b957-4303-a960-e24daa54a5e6 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: .version_select at 0x7f9d06af9ee0>, body: {"keypair": {"name": "tempest-keypair-1378523967", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBCznN25hkz2LR4hrma/a6YLgMBHcsyDsMXS6epKdVbisb8jQbGC8/c8ZWYfkFNqlUcPk4WmOd9ppQykavDY2PwzZbYlcVkP1bJWZNYlu5NFxsng6dCXkL84FY5NQ6+02WA=="}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:30.627383 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-f3a4b808-b957-4303-a960-e24daa54a5e6 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for project b807736ef6c54be2b4715f32a4cfea57. Resources: {'key_pairs'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:09:30.631301 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-f3a4b808-b957-4303-a960-e24daa54a5e6 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for user ea2f6b804e164dbcb4f67926f23fdd59 and project b807736ef6c54be2b4715f32a4cfea57. Resources: {'key_pairs'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:09:30.700551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f3a4b808-b957-4303-a960-e24daa54a5e6 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.094306 Sep 16 08:09:30.701190 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 298/557] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Sep 16 08:09:30 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:09:31.266487 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b251f4a7-2870-4184-aac4-635d81487fad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:31.267112 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b251f4a7-2870-4184-aac4-635d81487fad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:31.273552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b251f4a7-2870-4184-aac4-635d81487fad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:31.274061 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b251f4a7-2870-4184-aac4-635d81487fad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:31.274549 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b251f4a7-2870-4184-aac4-635d81487fad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:31.275269 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b251f4a7-2870-4184-aac4-635d81487fad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:31.275719 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b251f4a7-2870-4184-aac4-635d81487fad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:31.276141 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b251f4a7-2870-4184-aac4-635d81487fad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:31.409773 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b251f4a7-2870-4184-aac4-635d81487fad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:31.418091 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b251f4a7-2870-4184-aac4-635d81487fad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:31.419550 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b251f4a7-2870-4184-aac4-635d81487fad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:31.420689 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b251f4a7-2870-4184-aac4-635d81487fad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1754 microversion: 2.20 time: 0.158538 Sep 16 08:09:31.421242 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 260/558] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:31 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1754 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:32.447187 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-41b59d7c-61ce-4987-84ec-078ebeb31270 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:32.448083 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-41b59d7c-61ce-4987-84ec-078ebeb31270 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:32.454072 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-41b59d7c-61ce-4987-84ec-078ebeb31270 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:32.454568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-41b59d7c-61ce-4987-84ec-078ebeb31270 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:32.455038 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-41b59d7c-61ce-4987-84ec-078ebeb31270 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:32.455740 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-41b59d7c-61ce-4987-84ec-078ebeb31270 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:32.456200 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-41b59d7c-61ce-4987-84ec-078ebeb31270 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:32.456632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-41b59d7c-61ce-4987-84ec-078ebeb31270 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:32.657298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-41b59d7c-61ce-4987-84ec-078ebeb31270 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:32.665977 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-41b59d7c-61ce-4987-84ec-078ebeb31270 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:32.667459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-41b59d7c-61ce-4987-84ec-078ebeb31270 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:32.671778 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-41b59d7c-61ce-4987-84ec-078ebeb31270 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1754 microversion: 2.20 time: 0.226516 Sep 16 08:09:32.671778 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 299/559] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:32 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1754 bytes in 228 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:32.939927 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-419195870", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08ca5f04-b5f0-4538-b476-9e48665ae12b"}], "security_groups": [{"name": "tempest-securitygroup--238846574"}], "key_name": "tempest-keypair-1378523967", "user_data": "}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:33.044558 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.network.neutron [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] validate_networks() for [('08ca5f04-b5f0-4538-b476-9e48665ae12b', None, None, None, None, None)] {{(pid=121047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:09:33.412271 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Flavor limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:09:33.412699 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Image limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:09:33.413178 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Flavor pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:09:33.413597 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Image pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:09:33.414015 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:09:33.425776 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:33.426329 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:33.426821 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:33.427583 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:33.428020 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:33.431373 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:33.449418 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for project b807736ef6c54be2b4715f32a4cfea57. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:09:33.454070 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for user ea2f6b804e164dbcb4f67926f23fdd59 and project b807736ef6c54be2b4715f32a4cfea57. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:09:33.465231 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Going to run 1 instances... {{(pid=121047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:09:33.468285 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:09:33.625646 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-22d456ed-10f6-4c3e-b8db-5909adbc87dd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.689751 Sep 16 08:09:33.626379 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 261/560] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:09:32 2022] POST /compute/v2.1/servers => generated 401 bytes in 691 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:09:33.637603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9fb71c18-1d3d-426f-b5bf-25419a63d03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:33.638221 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-9fb71c18-1d3d-426f-b5bf-25419a63d03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:33.694097 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9c285e95-cb7f-49ca-a6ab-fff1a89686e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:33.694779 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9c285e95-cb7f-49ca-a6ab-fff1a89686e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:33.700394 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-9fb71c18-1d3d-426f-b5bf-25419a63d03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:33.706362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c285e95-cb7f-49ca-a6ab-fff1a89686e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:33.706362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c285e95-cb7f-49ca-a6ab-fff1a89686e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:33.706362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c285e95-cb7f-49ca-a6ab-fff1a89686e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:33.706362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c285e95-cb7f-49ca-a6ab-fff1a89686e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:33.706875 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c285e95-cb7f-49ca-a6ab-fff1a89686e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:33.707155 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c285e95-cb7f-49ca-a6ab-fff1a89686e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:33.710448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9fb71c18-1d3d-426f-b5bf-25419a63d03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1241 microversion: 2.1 time: 0.076784 Sep 16 08:09:33.711393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 300/561] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:33 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1241 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:33.841038 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9c285e95-cb7f-49ca-a6ab-fff1a89686e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:33.849841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9c285e95-cb7f-49ca-a6ab-fff1a89686e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:33.851370 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9c285e95-cb7f-49ca-a6ab-fff1a89686e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:33.853156 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9c285e95-cb7f-49ca-a6ab-fff1a89686e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1754 microversion: 2.20 time: 0.162948 Sep 16 08:09:33.853812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 262/562] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:33 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1754 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:34.214268 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-06294e9a-690a-4a48-8373-765059150c8d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Action: 'action', calling method: >, body: {"rescue": {"adminPass": "***"}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:34.216502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-06294e9a-690a-4a48-8373-765059150c8d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:34.223224 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-06294e9a-690a-4a48-8373-765059150c8d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:34.223645 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-06294e9a-690a-4a48-8373-765059150c8d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:34.224106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-06294e9a-690a-4a48-8373-765059150c8d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:34.224799 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-06294e9a-690a-4a48-8373-765059150c8d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:34.225246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-06294e9a-690a-4a48-8373-765059150c8d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:34.225670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-06294e9a-690a-4a48-8373-765059150c8d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:34.248183 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-06294e9a-690a-4a48-8373-765059150c8d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lazy-loading 'flavor' on Instance uuid 5e79005e-be5d-4326-aa8d-28bdef7f1a3b {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:09:34.583120 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-06294e9a-690a-4a48-8373-765059150c8d tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "POST /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/action" status: 200 len: 32 microversion: 2.1 time: 0.373277 Sep 16 08:09:34.583752 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 301/563] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:09:34 2022] POST /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/action => generated 32 bytes in 375 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 08:09:34.593049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3bac30e3-f730-4ae0-a53c-1f91b571b5e7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:34.593658 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3bac30e3-f730-4ae0-a53c-1f91b571b5e7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:34.599951 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3bac30e3-f730-4ae0-a53c-1f91b571b5e7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:34.600430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3bac30e3-f730-4ae0-a53c-1f91b571b5e7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:34.600865 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3bac30e3-f730-4ae0-a53c-1f91b571b5e7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:34.601556 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3bac30e3-f730-4ae0-a53c-1f91b571b5e7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:34.602011 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3bac30e3-f730-4ae0-a53c-1f91b571b5e7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:34.602939 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3bac30e3-f730-4ae0-a53c-1f91b571b5e7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:34.734610 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7a5da6d0-8499-4e48-a32c-c0887597a102 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:34.735438 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7a5da6d0-8499-4e48-a32c-c0887597a102 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:34.743787 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a5da6d0-8499-4e48-a32c-c0887597a102 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:34.744578 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a5da6d0-8499-4e48-a32c-c0887597a102 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:34.745091 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a5da6d0-8499-4e48-a32c-c0887597a102 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:34.745870 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a5da6d0-8499-4e48-a32c-c0887597a102 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:34.746483 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a5da6d0-8499-4e48-a32c-c0887597a102 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:34.747182 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7a5da6d0-8499-4e48-a32c-c0887597a102 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:34.768090 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3bac30e3-f730-4ae0-a53c-1f91b571b5e7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:34.776891 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3bac30e3-f730-4ae0-a53c-1f91b571b5e7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.187598 Sep 16 08:09:34.777727 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 263/564] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:34 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:34.814598 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7a5da6d0-8499-4e48-a32c-c0887597a102 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:34.823089 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7a5da6d0-8499-4e48-a32c-c0887597a102 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1245 microversion: 2.1 time: 0.092717 Sep 16 08:09:34.823666 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 302/565] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:34 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1245 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:34.879358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d7584a32-0cab-4f1a-8f4c-cc0660691cd6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:34.879977 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d7584a32-0cab-4f1a-8f4c-cc0660691cd6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:34.885969 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d7584a32-0cab-4f1a-8f4c-cc0660691cd6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:34.886461 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d7584a32-0cab-4f1a-8f4c-cc0660691cd6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:34.886931 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d7584a32-0cab-4f1a-8f4c-cc0660691cd6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:34.887650 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d7584a32-0cab-4f1a-8f4c-cc0660691cd6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:34.888098 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d7584a32-0cab-4f1a-8f4c-cc0660691cd6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:34.888530 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d7584a32-0cab-4f1a-8f4c-cc0660691cd6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:35.091017 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d7584a32-0cab-4f1a-8f4c-cc0660691cd6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:35.100680 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d7584a32-0cab-4f1a-8f4c-cc0660691cd6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:35.104559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d7584a32-0cab-4f1a-8f4c-cc0660691cd6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:35.105826 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d7584a32-0cab-4f1a-8f4c-cc0660691cd6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1754 microversion: 2.20 time: 0.230424 Sep 16 08:09:35.106486 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 264/566] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:34 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1754 bytes in 232 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:35.801433 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7100d5c9-8e6f-48ed-8b51-df859964b6ae tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:35.802037 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7100d5c9-8e6f-48ed-8b51-df859964b6ae tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:35.808879 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7100d5c9-8e6f-48ed-8b51-df859964b6ae tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:35.809360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7100d5c9-8e6f-48ed-8b51-df859964b6ae tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:35.809795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7100d5c9-8e6f-48ed-8b51-df859964b6ae tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:35.810513 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7100d5c9-8e6f-48ed-8b51-df859964b6ae tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:35.810992 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7100d5c9-8e6f-48ed-8b51-df859964b6ae tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:35.811413 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7100d5c9-8e6f-48ed-8b51-df859964b6ae tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:35.845264 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a15859f4-fce8-45a2-8bb4-46a9a6d2844b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:35.845903 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a15859f4-fce8-45a2-8bb4-46a9a6d2844b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:35.852478 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a15859f4-fce8-45a2-8bb4-46a9a6d2844b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:35.852961 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a15859f4-fce8-45a2-8bb4-46a9a6d2844b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:35.853393 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a15859f4-fce8-45a2-8bb4-46a9a6d2844b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:35.854084 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a15859f4-fce8-45a2-8bb4-46a9a6d2844b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:35.854531 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a15859f4-fce8-45a2-8bb4-46a9a6d2844b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:35.854980 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a15859f4-fce8-45a2-8bb4-46a9a6d2844b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:35.921241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a15859f4-fce8-45a2-8bb4-46a9a6d2844b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:35.929817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a15859f4-fce8-45a2-8bb4-46a9a6d2844b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1301 microversion: 2.1 time: 0.088213 Sep 16 08:09:35.932542 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 265/567] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:35 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1301 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:35.962917 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7100d5c9-8e6f-48ed-8b51-df859964b6ae tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:35.973803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7100d5c9-8e6f-48ed-8b51-df859964b6ae tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.176255 Sep 16 08:09:35.974389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 303/568] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:35 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:36.132788 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0681cacb-38b1-4341-b6a1-55981ea9744f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:36.133617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0681cacb-38b1-4341-b6a1-55981ea9744f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:36.139972 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0681cacb-38b1-4341-b6a1-55981ea9744f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:36.140657 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0681cacb-38b1-4341-b6a1-55981ea9744f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:36.141178 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0681cacb-38b1-4341-b6a1-55981ea9744f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:36.142087 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0681cacb-38b1-4341-b6a1-55981ea9744f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:36.142618 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0681cacb-38b1-4341-b6a1-55981ea9744f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:36.143127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0681cacb-38b1-4341-b6a1-55981ea9744f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:36.312161 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0681cacb-38b1-4341-b6a1-55981ea9744f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:36.319211 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0681cacb-38b1-4341-b6a1-55981ea9744f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:36.320653 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0681cacb-38b1-4341-b6a1-55981ea9744f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:36.321857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0681cacb-38b1-4341-b6a1-55981ea9744f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.193061 Sep 16 08:09:36.322406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 266/569] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:36 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:36.963009 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8be11201-2252-4fcb-a525-be890928ffc0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:36.963009 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8be11201-2252-4fcb-a525-be890928ffc0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:36.966673 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8be11201-2252-4fcb-a525-be890928ffc0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:36.967204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8be11201-2252-4fcb-a525-be890928ffc0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:36.967636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8be11201-2252-4fcb-a525-be890928ffc0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:36.968324 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8be11201-2252-4fcb-a525-be890928ffc0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:36.968857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8be11201-2252-4fcb-a525-be890928ffc0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:36.969277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8be11201-2252-4fcb-a525-be890928ffc0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:36.997682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-300bbf0b-6799-45d9-8e24-32e74420c92f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:36.999208 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-300bbf0b-6799-45d9-8e24-32e74420c92f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:37.011587 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=96,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:37.013483 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-300bbf0b-6799-45d9-8e24-32e74420c92f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:37.013976 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-300bbf0b-6799-45d9-8e24-32e74420c92f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:37.014417 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-300bbf0b-6799-45d9-8e24-32e74420c92f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:37.015346 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-300bbf0b-6799-45d9-8e24-32e74420c92f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:37.015810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-300bbf0b-6799-45d9-8e24-32e74420c92f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:37.016239 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-300bbf0b-6799-45d9-8e24-32e74420c92f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:37.226760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8be11201-2252-4fcb-a525-be890928ffc0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:37.234991 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8be11201-2252-4fcb-a525-be890928ffc0 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.280217 Sep 16 08:09:37.235560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 304/570] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:36 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 282 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:37.269294 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-300bbf0b-6799-45d9-8e24-32e74420c92f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:37.278102 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-300bbf0b-6799-45d9-8e24-32e74420c92f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.285120 Sep 16 08:09:37.278839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 267/571] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:36 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:37.346225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ff13e108-7d2c-4fd7-84f2-2006cbcd26ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:37.347033 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ff13e108-7d2c-4fd7-84f2-2006cbcd26ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:37.352946 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff13e108-7d2c-4fd7-84f2-2006cbcd26ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:37.356883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff13e108-7d2c-4fd7-84f2-2006cbcd26ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:37.356883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff13e108-7d2c-4fd7-84f2-2006cbcd26ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:37.356883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff13e108-7d2c-4fd7-84f2-2006cbcd26ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:37.356883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff13e108-7d2c-4fd7-84f2-2006cbcd26ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:37.357364 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff13e108-7d2c-4fd7-84f2-2006cbcd26ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:37.565360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ff13e108-7d2c-4fd7-84f2-2006cbcd26ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:37.575911 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ff13e108-7d2c-4fd7-84f2-2006cbcd26ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:37.577616 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ff13e108-7d2c-4fd7-84f2-2006cbcd26ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:37.579195 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ff13e108-7d2c-4fd7-84f2-2006cbcd26ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.237032 Sep 16 08:09:37.580428 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 305/572] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:37 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 239 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:38.020691 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-70996d01-860d-4531-a8d5-4dfbf9567b28 req-74369274-2f03-4678-a7e9-f707cdd2a92b service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea13dc92-1066-46f6-9fda-8d87d3721731", "tag": "5b2d3958-4467-4e0e-8120-6287840453ee"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:38.031902 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-70996d01-860d-4531-a8d5-4dfbf9567b28 req-74369274-2f03-4678-a7e9-f707cdd2a92b service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:38.032386 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-70996d01-860d-4531-a8d5-4dfbf9567b28 req-74369274-2f03-4678-a7e9-f707cdd2a92b service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:38.032821 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-70996d01-860d-4531-a8d5-4dfbf9567b28 req-74369274-2f03-4678-a7e9-f707cdd2a92b service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:38.047204 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-70996d01-860d-4531-a8d5-4dfbf9567b28 req-74369274-2f03-4678-a7e9-f707cdd2a92b service nova] Creating event network-changed:5b2d3958-4467-4e0e-8120-6287840453ee for instance ea13dc92-1066-46f6-9fda-8d87d3721731 on hv-cinder-74014 Sep 16 08:09:38.057278 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-70996d01-860d-4531-a8d5-4dfbf9567b28 req-74369274-2f03-4678-a7e9-f707cdd2a92b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.040228 Sep 16 08:09:38.057891 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 268/573] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:09:38 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:09:38.261374 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-32ac850c-9661-46fb-a831-1174e3da029f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:38.261993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-32ac850c-9661-46fb-a831-1174e3da029f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:38.268277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32ac850c-9661-46fb-a831-1174e3da029f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:38.268762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32ac850c-9661-46fb-a831-1174e3da029f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:38.269199 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32ac850c-9661-46fb-a831-1174e3da029f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:38.269903 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32ac850c-9661-46fb-a831-1174e3da029f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:38.270357 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32ac850c-9661-46fb-a831-1174e3da029f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:38.270804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-32ac850c-9661-46fb-a831-1174e3da029f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:38.302790 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e8c6011c-5fde-4121-b65f-d8d98115909e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:38.303485 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e8c6011c-5fde-4121-b65f-d8d98115909e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:38.310708 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e8c6011c-5fde-4121-b65f-d8d98115909e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:38.311230 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e8c6011c-5fde-4121-b65f-d8d98115909e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:38.311653 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e8c6011c-5fde-4121-b65f-d8d98115909e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:38.312400 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e8c6011c-5fde-4121-b65f-d8d98115909e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:38.312862 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e8c6011c-5fde-4121-b65f-d8d98115909e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:38.313288 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e8c6011c-5fde-4121-b65f-d8d98115909e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:38.415387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-32ac850c-9661-46fb-a831-1174e3da029f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:38.423201 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-32ac850c-9661-46fb-a831-1174e3da029f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.165759 Sep 16 08:09:38.423955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 306/574] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:38 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:38.517825 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e8c6011c-5fde-4121-b65f-d8d98115909e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:38.529385 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e8c6011c-5fde-4121-b65f-d8d98115909e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.231227 Sep 16 08:09:38.549689 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 269/575] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:38 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 253 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:38.605581 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-89cc9f04-07ce-4f22-8e7e-185c210697dc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:38.606497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-89cc9f04-07ce-4f22-8e7e-185c210697dc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:38.612731 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-89cc9f04-07ce-4f22-8e7e-185c210697dc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:38.613425 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-89cc9f04-07ce-4f22-8e7e-185c210697dc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:38.614030 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-89cc9f04-07ce-4f22-8e7e-185c210697dc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:38.614947 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-89cc9f04-07ce-4f22-8e7e-185c210697dc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:38.615557 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-89cc9f04-07ce-4f22-8e7e-185c210697dc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:38.616127 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-89cc9f04-07ce-4f22-8e7e-185c210697dc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:38.775209 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-89cc9f04-07ce-4f22-8e7e-185c210697dc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:38.784275 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-89cc9f04-07ce-4f22-8e7e-185c210697dc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:38.785968 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-89cc9f04-07ce-4f22-8e7e-185c210697dc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:38.787187 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-89cc9f04-07ce-4f22-8e7e-185c210697dc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.186075 Sep 16 08:09:38.787744 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 307/576] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:38 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:39.446467 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3668601d-4b28-430e-ab79-e7a2b1e8917a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:39.447180 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3668601d-4b28-430e-ab79-e7a2b1e8917a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:39.453881 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3668601d-4b28-430e-ab79-e7a2b1e8917a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:39.454449 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3668601d-4b28-430e-ab79-e7a2b1e8917a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:39.454916 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3668601d-4b28-430e-ab79-e7a2b1e8917a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:39.455617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3668601d-4b28-430e-ab79-e7a2b1e8917a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:39.456069 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3668601d-4b28-430e-ab79-e7a2b1e8917a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:39.456500 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3668601d-4b28-430e-ab79-e7a2b1e8917a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:39.560583 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-24df55ce-6a7c-4c85-a6a9-5b045baf12a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:39.561800 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-24df55ce-6a7c-4c85-a6a9-5b045baf12a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:39.568182 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-24df55ce-6a7c-4c85-a6a9-5b045baf12a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:39.568676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-24df55ce-6a7c-4c85-a6a9-5b045baf12a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:39.569117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-24df55ce-6a7c-4c85-a6a9-5b045baf12a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:39.569821 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-24df55ce-6a7c-4c85-a6a9-5b045baf12a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:39.570281 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-24df55ce-6a7c-4c85-a6a9-5b045baf12a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:39.570773 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-24df55ce-6a7c-4c85-a6a9-5b045baf12a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:39.575018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:39.591830 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3668601d-4b28-430e-ab79-e7a2b1e8917a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:39.600143 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3668601d-4b28-430e-ab79-e7a2b1e8917a tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.157718 Sep 16 08:09:39.615662 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 270/577] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:39 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:39.713808 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-24df55ce-6a7c-4c85-a6a9-5b045baf12a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:39.727075 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-24df55ce-6a7c-4c85-a6a9-5b045baf12a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.170363 Sep 16 08:09:39.728246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 308/578] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:39 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:39.813126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-dce4fd31-7a20-4465-952e-dd552d8c8069 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:39.813728 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-dce4fd31-7a20-4465-952e-dd552d8c8069 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:39.820367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dce4fd31-7a20-4465-952e-dd552d8c8069 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:39.820940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dce4fd31-7a20-4465-952e-dd552d8c8069 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:39.821431 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dce4fd31-7a20-4465-952e-dd552d8c8069 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:39.822305 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dce4fd31-7a20-4465-952e-dd552d8c8069 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:39.822778 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dce4fd31-7a20-4465-952e-dd552d8c8069 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:39.823205 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dce4fd31-7a20-4465-952e-dd552d8c8069 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:39.959934 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dce4fd31-7a20-4465-952e-dd552d8c8069 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:39.970052 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dce4fd31-7a20-4465-952e-dd552d8c8069 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:39.971472 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dce4fd31-7a20-4465-952e-dd552d8c8069 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:39.972639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-dce4fd31-7a20-4465-952e-dd552d8c8069 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.163467 Sep 16 08:09:39.973198 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 271/579] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:39 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:40.625687 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-10138a15-b290-461e-918b-76def963a9b1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:40.626350 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-10138a15-b290-461e-918b-76def963a9b1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:40.633224 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-10138a15-b290-461e-918b-76def963a9b1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:40.633960 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-10138a15-b290-461e-918b-76def963a9b1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:40.634405 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-10138a15-b290-461e-918b-76def963a9b1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:40.635144 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-10138a15-b290-461e-918b-76def963a9b1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:40.635609 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-10138a15-b290-461e-918b-76def963a9b1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:40.636039 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-10138a15-b290-461e-918b-76def963a9b1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:40.751127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-256fdc53-20f8-437e-ae39-fcaccbd73a7c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:40.752376 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-256fdc53-20f8-437e-ae39-fcaccbd73a7c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:40.760449 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-256fdc53-20f8-437e-ae39-fcaccbd73a7c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:40.761448 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-256fdc53-20f8-437e-ae39-fcaccbd73a7c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:40.762056 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-256fdc53-20f8-437e-ae39-fcaccbd73a7c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:40.762951 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-256fdc53-20f8-437e-ae39-fcaccbd73a7c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:40.763576 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-256fdc53-20f8-437e-ae39-fcaccbd73a7c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:40.764052 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-256fdc53-20f8-437e-ae39-fcaccbd73a7c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:40.776088 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-10138a15-b290-461e-918b-76def963a9b1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:40.787386 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-10138a15-b290-461e-918b-76def963a9b1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.165708 Sep 16 08:09:40.788088 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 309/580] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:40 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:40.901937 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-256fdc53-20f8-437e-ae39-fcaccbd73a7c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:40.911424 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-256fdc53-20f8-437e-ae39-fcaccbd73a7c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.164011 Sep 16 08:09:40.912211 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 272/581] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:40 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:40.998214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-10c2416d-a51d-4b25-ae70-ca729473487b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:40.999022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-10c2416d-a51d-4b25-ae70-ca729473487b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:41.005153 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-10c2416d-a51d-4b25-ae70-ca729473487b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:41.005631 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-10c2416d-a51d-4b25-ae70-ca729473487b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:41.006074 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-10c2416d-a51d-4b25-ae70-ca729473487b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:41.006807 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-10c2416d-a51d-4b25-ae70-ca729473487b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:41.007276 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-10c2416d-a51d-4b25-ae70-ca729473487b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:41.007706 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-10c2416d-a51d-4b25-ae70-ca729473487b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:41.140056 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-10c2416d-a51d-4b25-ae70-ca729473487b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:41.149128 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-10c2416d-a51d-4b25-ae70-ca729473487b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:41.152646 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-10c2416d-a51d-4b25-ae70-ca729473487b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:41.152646 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-10c2416d-a51d-4b25-ae70-ca729473487b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.158141 Sep 16 08:09:41.153284 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 310/582] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:40 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:41.811742 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-996e9c21-b21d-4063-9143-36a5df98e830 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:41.812479 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-996e9c21-b21d-4063-9143-36a5df98e830 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:41.819145 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-996e9c21-b21d-4063-9143-36a5df98e830 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:41.819635 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-996e9c21-b21d-4063-9143-36a5df98e830 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:41.820072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-996e9c21-b21d-4063-9143-36a5df98e830 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:41.820772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-996e9c21-b21d-4063-9143-36a5df98e830 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:41.821898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-996e9c21-b21d-4063-9143-36a5df98e830 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:41.822332 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-996e9c21-b21d-4063-9143-36a5df98e830 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:41.938152 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2b5d53f9-5210-4735-b436-b0f8cb1604d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:41.939177 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2b5d53f9-5210-4735-b436-b0f8cb1604d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:41.947442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b5d53f9-5210-4735-b436-b0f8cb1604d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:41.947974 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b5d53f9-5210-4735-b436-b0f8cb1604d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:41.948445 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b5d53f9-5210-4735-b436-b0f8cb1604d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:41.949389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b5d53f9-5210-4735-b436-b0f8cb1604d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:41.949856 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b5d53f9-5210-4735-b436-b0f8cb1604d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:41.950289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b5d53f9-5210-4735-b436-b0f8cb1604d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:41.962855 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-996e9c21-b21d-4063-9143-36a5df98e830 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:41.972308 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-996e9c21-b21d-4063-9143-36a5df98e830 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.164456 Sep 16 08:09:41.973162 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 273/583] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:41 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:42.179199 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fe6196b0-d5e5-4ea2-9330-42aee1ef67e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:42.179846 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-fe6196b0-d5e5-4ea2-9330-42aee1ef67e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:42.187822 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fe6196b0-d5e5-4ea2-9330-42aee1ef67e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:42.188351 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fe6196b0-d5e5-4ea2-9330-42aee1ef67e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:42.188792 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fe6196b0-d5e5-4ea2-9330-42aee1ef67e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:42.189506 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fe6196b0-d5e5-4ea2-9330-42aee1ef67e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:42.189967 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fe6196b0-d5e5-4ea2-9330-42aee1ef67e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:42.193865 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fe6196b0-d5e5-4ea2-9330-42aee1ef67e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:42.364824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2b5d53f9-5210-4735-b436-b0f8cb1604d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:42.369038 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fe6196b0-d5e5-4ea2-9330-42aee1ef67e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:42.373936 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2b5d53f9-5210-4735-b436-b0f8cb1604d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.440008 Sep 16 08:09:42.374753 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 311/584] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:41 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 441 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:42.382486 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fe6196b0-d5e5-4ea2-9330-42aee1ef67e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:42.384609 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fe6196b0-d5e5-4ea2-9330-42aee1ef67e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:42.385852 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-fe6196b0-d5e5-4ea2-9330-42aee1ef67e4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.210955 Sep 16 08:09:42.397320 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 274/585] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:42 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 223 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:42.996084 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-96c18db4-1114-4e7f-bbab-48507a26a706 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:42.996659 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-96c18db4-1114-4e7f-bbab-48507a26a706 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:43.003069 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-96c18db4-1114-4e7f-bbab-48507a26a706 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:43.003551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-96c18db4-1114-4e7f-bbab-48507a26a706 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:43.003983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-96c18db4-1114-4e7f-bbab-48507a26a706 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:43.004664 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-96c18db4-1114-4e7f-bbab-48507a26a706 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:43.005118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-96c18db4-1114-4e7f-bbab-48507a26a706 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:43.005539 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-96c18db4-1114-4e7f-bbab-48507a26a706 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:43.137253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-96c18db4-1114-4e7f-bbab-48507a26a706 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:43.145109 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-96c18db4-1114-4e7f-bbab-48507a26a706 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.153486 Sep 16 08:09:43.145773 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 312/586] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:42 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:43.402106 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6bf2e38f-edd6-4f88-82f6-8b7a5af98a09 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:43.402668 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6bf2e38f-edd6-4f88-82f6-8b7a5af98a09 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:43.409925 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6bf2e38f-edd6-4f88-82f6-8b7a5af98a09 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:43.410878 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6bf2e38f-edd6-4f88-82f6-8b7a5af98a09 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:43.411344 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6bf2e38f-edd6-4f88-82f6-8b7a5af98a09 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:43.412037 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6bf2e38f-edd6-4f88-82f6-8b7a5af98a09 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:43.412501 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6bf2e38f-edd6-4f88-82f6-8b7a5af98a09 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:43.413002 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6bf2e38f-edd6-4f88-82f6-8b7a5af98a09 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:43.418773 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6254a356-cf20-4216-9f97-e25eb3df37f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:43.419378 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6254a356-cf20-4216-9f97-e25eb3df37f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:43.425302 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6254a356-cf20-4216-9f97-e25eb3df37f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:43.425802 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6254a356-cf20-4216-9f97-e25eb3df37f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:43.426243 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6254a356-cf20-4216-9f97-e25eb3df37f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:43.426982 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6254a356-cf20-4216-9f97-e25eb3df37f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:43.427444 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6254a356-cf20-4216-9f97-e25eb3df37f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:43.427872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6254a356-cf20-4216-9f97-e25eb3df37f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:43.437464 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:43.460869 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=6 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:43.561894 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6bf2e38f-edd6-4f88-82f6-8b7a5af98a09 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:43.571431 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6bf2e38f-edd6-4f88-82f6-8b7a5af98a09 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.173720 Sep 16 08:09:43.572014 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 275/587] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:43 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:43.593698 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6254a356-cf20-4216-9f97-e25eb3df37f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:43.603078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6254a356-cf20-4216-9f97-e25eb3df37f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:43.605463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6254a356-cf20-4216-9f97-e25eb3df37f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:43.606734 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6254a356-cf20-4216-9f97-e25eb3df37f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.198686 Sep 16 08:09:43.607521 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 313/588] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:43 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:44.170151 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-95ef8337-50b2-462c-83fb-815a096def73 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:44.171003 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-95ef8337-50b2-462c-83fb-815a096def73 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:44.177847 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95ef8337-50b2-462c-83fb-815a096def73 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:44.178343 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95ef8337-50b2-462c-83fb-815a096def73 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:44.178965 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95ef8337-50b2-462c-83fb-815a096def73 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:44.179675 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95ef8337-50b2-462c-83fb-815a096def73 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:44.180133 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95ef8337-50b2-462c-83fb-815a096def73 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:44.181067 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-95ef8337-50b2-462c-83fb-815a096def73 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:44.319480 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-95ef8337-50b2-462c-83fb-815a096def73 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:44.341087 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-95ef8337-50b2-462c-83fb-815a096def73 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.176305 Sep 16 08:09:44.341878 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 276/589] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:44 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:44.604949 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5471f3c9-7b27-40b7-ac61-c73a23e27c9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:44.606622 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5471f3c9-7b27-40b7-ac61-c73a23e27c9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:44.614616 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=6 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:44.617768 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5471f3c9-7b27-40b7-ac61-c73a23e27c9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:44.618664 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5471f3c9-7b27-40b7-ac61-c73a23e27c9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:44.619244 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5471f3c9-7b27-40b7-ac61-c73a23e27c9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:44.620085 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5471f3c9-7b27-40b7-ac61-c73a23e27c9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:44.620794 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5471f3c9-7b27-40b7-ac61-c73a23e27c9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:44.621467 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5471f3c9-7b27-40b7-ac61-c73a23e27c9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:44.632876 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-554c9e90-57d5-468d-bb8a-4d1850a53f71 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:44.634077 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-554c9e90-57d5-468d-bb8a-4d1850a53f71 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:44.660295 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-554c9e90-57d5-468d-bb8a-4d1850a53f71 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:44.660800 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-554c9e90-57d5-468d-bb8a-4d1850a53f71 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:44.661293 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-554c9e90-57d5-468d-bb8a-4d1850a53f71 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:44.662057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-554c9e90-57d5-468d-bb8a-4d1850a53f71 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:44.662624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-554c9e90-57d5-468d-bb8a-4d1850a53f71 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:44.663124 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-554c9e90-57d5-468d-bb8a-4d1850a53f71 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:44.667693 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=100 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:44.795892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5471f3c9-7b27-40b7-ac61-c73a23e27c9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:44.805276 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5471f3c9-7b27-40b7-ac61-c73a23e27c9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.212523 Sep 16 08:09:44.810731 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 314/590] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:44 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:44.823472 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-554c9e90-57d5-468d-bb8a-4d1850a53f71 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:44.833536 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-554c9e90-57d5-468d-bb8a-4d1850a53f71 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:44.843799 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-554c9e90-57d5-468d-bb8a-4d1850a53f71 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:44.843799 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-554c9e90-57d5-468d-bb8a-4d1850a53f71 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.207800 Sep 16 08:09:44.843799 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 277/591] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:44 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:45.364845 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-bf218054-0708-49cb-846c-ac60e4b4d32b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:45.365456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-bf218054-0708-49cb-846c-ac60e4b4d32b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:45.372236 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bf218054-0708-49cb-846c-ac60e4b4d32b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:45.372720 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bf218054-0708-49cb-846c-ac60e4b4d32b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:45.373162 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bf218054-0708-49cb-846c-ac60e4b4d32b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:45.373852 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bf218054-0708-49cb-846c-ac60e4b4d32b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:45.374317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bf218054-0708-49cb-846c-ac60e4b4d32b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:45.374775 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bf218054-0708-49cb-846c-ac60e4b4d32b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:45.522537 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-bf218054-0708-49cb-846c-ac60e4b4d32b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:45.531632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-bf218054-0708-49cb-846c-ac60e4b4d32b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.170948 Sep 16 08:09:45.532214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 315/592] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:45 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:45.831511 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e2e61d56-7479-49e7-9fd6-ab4d67d1e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:45.832347 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e2e61d56-7479-49e7-9fd6-ab4d67d1e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:45.841264 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e2e61d56-7479-49e7-9fd6-ab4d67d1e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:45.841909 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e2e61d56-7479-49e7-9fd6-ab4d67d1e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:45.842377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e2e61d56-7479-49e7-9fd6-ab4d67d1e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:45.843349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e2e61d56-7479-49e7-9fd6-ab4d67d1e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:45.843810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e2e61d56-7479-49e7-9fd6-ab4d67d1e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:45.844324 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e2e61d56-7479-49e7-9fd6-ab4d67d1e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:45.867238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cf214548-cadc-4b22-b87d-fb40bd3d655c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:45.868585 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cf214548-cadc-4b22-b87d-fb40bd3d655c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:45.876110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf214548-cadc-4b22-b87d-fb40bd3d655c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:45.884090 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf214548-cadc-4b22-b87d-fb40bd3d655c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.008s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:45.885085 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf214548-cadc-4b22-b87d-fb40bd3d655c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:45.885835 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf214548-cadc-4b22-b87d-fb40bd3d655c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:45.886293 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf214548-cadc-4b22-b87d-fb40bd3d655c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:45.886762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf214548-cadc-4b22-b87d-fb40bd3d655c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:45.992774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e2e61d56-7479-49e7-9fd6-ab4d67d1e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:46.001533 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e2e61d56-7479-49e7-9fd6-ab4d67d1e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.174159 Sep 16 08:09:46.002403 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 278/593] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:45 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:46.034123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cf214548-cadc-4b22-b87d-fb40bd3d655c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:46.045466 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cf214548-cadc-4b22-b87d-fb40bd3d655c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:46.047218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cf214548-cadc-4b22-b87d-fb40bd3d655c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:46.048397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cf214548-cadc-4b22-b87d-fb40bd3d655c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.184958 Sep 16 08:09:46.049320 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 316/594] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:45 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:46.554975 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b04afc63-edab-4e98-9c2f-8ce6fb19bf70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:46.557664 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b04afc63-edab-4e98-9c2f-8ce6fb19bf70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:46.562146 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b04afc63-edab-4e98-9c2f-8ce6fb19bf70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:46.563309 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b04afc63-edab-4e98-9c2f-8ce6fb19bf70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:46.563309 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b04afc63-edab-4e98-9c2f-8ce6fb19bf70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:46.563981 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b04afc63-edab-4e98-9c2f-8ce6fb19bf70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:46.564412 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b04afc63-edab-4e98-9c2f-8ce6fb19bf70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:46.564847 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b04afc63-edab-4e98-9c2f-8ce6fb19bf70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:46.707231 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b04afc63-edab-4e98-9c2f-8ce6fb19bf70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:46.716216 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b04afc63-edab-4e98-9c2f-8ce6fb19bf70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.165196 Sep 16 08:09:46.718131 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 279/595] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:46 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:47.029962 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-18a7dd72-2d6f-4d98-bebf-44267d27fc57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:47.030851 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-18a7dd72-2d6f-4d98-bebf-44267d27fc57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:47.037344 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18a7dd72-2d6f-4d98-bebf-44267d27fc57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:47.037836 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18a7dd72-2d6f-4d98-bebf-44267d27fc57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:47.038341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18a7dd72-2d6f-4d98-bebf-44267d27fc57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:47.039168 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18a7dd72-2d6f-4d98-bebf-44267d27fc57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:47.039513 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18a7dd72-2d6f-4d98-bebf-44267d27fc57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:47.039935 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18a7dd72-2d6f-4d98-bebf-44267d27fc57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:47.074914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-cb6bd0c0-a550-4871-a9af-c50d88546c94 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:47.076139 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-cb6bd0c0-a550-4871-a9af-c50d88546c94 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:47.083154 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cb6bd0c0-a550-4871-a9af-c50d88546c94 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:47.083915 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cb6bd0c0-a550-4871-a9af-c50d88546c94 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:47.084358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cb6bd0c0-a550-4871-a9af-c50d88546c94 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:47.085076 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cb6bd0c0-a550-4871-a9af-c50d88546c94 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:47.085537 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cb6bd0c0-a550-4871-a9af-c50d88546c94 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:47.085963 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cb6bd0c0-a550-4871-a9af-c50d88546c94 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:47.175757 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-18a7dd72-2d6f-4d98-bebf-44267d27fc57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:47.184837 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-18a7dd72-2d6f-4d98-bebf-44267d27fc57 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.158607 Sep 16 08:09:47.197309 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 317/596] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:47 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:47.230110 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cb6bd0c0-a550-4871-a9af-c50d88546c94 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:47.238887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cb6bd0c0-a550-4871-a9af-c50d88546c94 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:47.240358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cb6bd0c0-a550-4871-a9af-c50d88546c94 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:47.241523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-cb6bd0c0-a550-4871-a9af-c50d88546c94 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.170553 Sep 16 08:09:47.242087 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 280/597] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:47 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:47.743185 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d67df2f1-566a-40c8-9261-e26e2a2526d5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:47.744298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d67df2f1-566a-40c8-9261-e26e2a2526d5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:47.750672 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d67df2f1-566a-40c8-9261-e26e2a2526d5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:47.751193 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d67df2f1-566a-40c8-9261-e26e2a2526d5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:47.751635 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d67df2f1-566a-40c8-9261-e26e2a2526d5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:47.752341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d67df2f1-566a-40c8-9261-e26e2a2526d5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:47.752836 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d67df2f1-566a-40c8-9261-e26e2a2526d5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:47.753250 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d67df2f1-566a-40c8-9261-e26e2a2526d5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:47.898301 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d67df2f1-566a-40c8-9261-e26e2a2526d5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:47.898301 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d67df2f1-566a-40c8-9261-e26e2a2526d5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.158566 Sep 16 08:09:47.898557 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 318/598] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:47 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:48.207655 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-86d8bc24-1c57-4ce0-ba1a-15860d477662 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:48.208270 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-86d8bc24-1c57-4ce0-ba1a-15860d477662 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:48.214912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86d8bc24-1c57-4ce0-ba1a-15860d477662 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:48.215402 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86d8bc24-1c57-4ce0-ba1a-15860d477662 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:48.215848 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86d8bc24-1c57-4ce0-ba1a-15860d477662 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:48.216544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86d8bc24-1c57-4ce0-ba1a-15860d477662 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:48.217029 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86d8bc24-1c57-4ce0-ba1a-15860d477662 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:48.217462 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-86d8bc24-1c57-4ce0-ba1a-15860d477662 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:48.267965 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-28242028-4b20-44fc-9f1c-2fb02840d709 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:48.268599 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-28242028-4b20-44fc-9f1c-2fb02840d709 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:48.275134 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-28242028-4b20-44fc-9f1c-2fb02840d709 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:48.275703 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-28242028-4b20-44fc-9f1c-2fb02840d709 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:48.276220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-28242028-4b20-44fc-9f1c-2fb02840d709 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:48.277011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-28242028-4b20-44fc-9f1c-2fb02840d709 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:48.277610 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-28242028-4b20-44fc-9f1c-2fb02840d709 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:48.278119 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-28242028-4b20-44fc-9f1c-2fb02840d709 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:48.350212 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-86d8bc24-1c57-4ce0-ba1a-15860d477662 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:48.359552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-86d8bc24-1c57-4ce0-ba1a-15860d477662 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.155757 Sep 16 08:09:48.360143 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 281/599] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:48 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:48.406470 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-28242028-4b20-44fc-9f1c-2fb02840d709 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:48.415050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-28242028-4b20-44fc-9f1c-2fb02840d709 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:48.417398 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-28242028-4b20-44fc-9f1c-2fb02840d709 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:48.418545 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-28242028-4b20-44fc-9f1c-2fb02840d709 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.154886 Sep 16 08:09:48.419124 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 319/600] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:48 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:48.920974 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0d28391e-8faf-4481-9555-a3b63807f048 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:48.921590 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0d28391e-8faf-4481-9555-a3b63807f048 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:48.927555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0d28391e-8faf-4481-9555-a3b63807f048 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:48.928036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0d28391e-8faf-4481-9555-a3b63807f048 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:48.928473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0d28391e-8faf-4481-9555-a3b63807f048 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:48.929163 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0d28391e-8faf-4481-9555-a3b63807f048 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:48.929615 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0d28391e-8faf-4481-9555-a3b63807f048 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:48.930040 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0d28391e-8faf-4481-9555-a3b63807f048 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:49.054217 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0d28391e-8faf-4481-9555-a3b63807f048 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:49.061727 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0d28391e-8faf-4481-9555-a3b63807f048 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.144585 Sep 16 08:09:49.062292 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 282/601] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:48 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:49.383280 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-59d81ef9-ccf9-454d-aa9b-930cafe368cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:49.383846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-59d81ef9-ccf9-454d-aa9b-930cafe368cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:49.390815 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-59d81ef9-ccf9-454d-aa9b-930cafe368cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:49.391296 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-59d81ef9-ccf9-454d-aa9b-930cafe368cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:49.391740 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-59d81ef9-ccf9-454d-aa9b-930cafe368cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:49.392417 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-59d81ef9-ccf9-454d-aa9b-930cafe368cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:49.392871 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-59d81ef9-ccf9-454d-aa9b-930cafe368cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:49.393297 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-59d81ef9-ccf9-454d-aa9b-930cafe368cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:49.443770 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b8b91f6e-a71c-4fbd-a245-52b1fe143d1a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:49.445020 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b8b91f6e-a71c-4fbd-a245-52b1fe143d1a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:49.452311 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8b91f6e-a71c-4fbd-a245-52b1fe143d1a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:49.453830 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8b91f6e-a71c-4fbd-a245-52b1fe143d1a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:49.454387 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8b91f6e-a71c-4fbd-a245-52b1fe143d1a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:49.455249 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8b91f6e-a71c-4fbd-a245-52b1fe143d1a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:49.455885 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8b91f6e-a71c-4fbd-a245-52b1fe143d1a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:49.456312 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8b91f6e-a71c-4fbd-a245-52b1fe143d1a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:49.528765 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-59d81ef9-ccf9-454d-aa9b-930cafe368cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:49.537655 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-59d81ef9-ccf9-454d-aa9b-930cafe368cc tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.158276 Sep 16 08:09:49.538227 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 320/602] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:49 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:49.661585 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b8b91f6e-a71c-4fbd-a245-52b1fe143d1a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:49.670868 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b8b91f6e-a71c-4fbd-a245-52b1fe143d1a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:49.672317 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b8b91f6e-a71c-4fbd-a245-52b1fe143d1a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:49.673479 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b8b91f6e-a71c-4fbd-a245-52b1fe143d1a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.233637 Sep 16 08:09:49.674108 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 283/603] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:49 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:50.084440 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2dfabdb4-36e7-493d-ad15-179ee7adf03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:50.085047 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2dfabdb4-36e7-493d-ad15-179ee7adf03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:50.091432 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2dfabdb4-36e7-493d-ad15-179ee7adf03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:50.091908 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2dfabdb4-36e7-493d-ad15-179ee7adf03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:50.092341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2dfabdb4-36e7-493d-ad15-179ee7adf03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:50.093022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2dfabdb4-36e7-493d-ad15-179ee7adf03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:50.093473 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2dfabdb4-36e7-493d-ad15-179ee7adf03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:50.093893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2dfabdb4-36e7-493d-ad15-179ee7adf03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:50.220310 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2dfabdb4-36e7-493d-ad15-179ee7adf03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:50.227801 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2dfabdb4-36e7-493d-ad15-179ee7adf03f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.147216 Sep 16 08:09:50.229016 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 321/604] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:50 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:50.561064 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7ecdb620-9ec1-45d4-bf9e-63b9d70c2d56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:50.561677 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7ecdb620-9ec1-45d4-bf9e-63b9d70c2d56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:50.568106 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ecdb620-9ec1-45d4-bf9e-63b9d70c2d56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:50.568586 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ecdb620-9ec1-45d4-bf9e-63b9d70c2d56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:50.569023 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ecdb620-9ec1-45d4-bf9e-63b9d70c2d56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:50.569707 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ecdb620-9ec1-45d4-bf9e-63b9d70c2d56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:50.570160 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ecdb620-9ec1-45d4-bf9e-63b9d70c2d56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:50.570583 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ecdb620-9ec1-45d4-bf9e-63b9d70c2d56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:50.697756 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7ecdb620-9ec1-45d4-bf9e-63b9d70c2d56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:50.700370 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-da68f81d-10e2-4616-8368-08a473e078a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:50.701554 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-da68f81d-10e2-4616-8368-08a473e078a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:50.706202 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7ecdb620-9ec1-45d4-bf9e-63b9d70c2d56 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.148939 Sep 16 08:09:50.706791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 284/605] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:50 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:50.707381 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da68f81d-10e2-4616-8368-08a473e078a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:50.707871 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da68f81d-10e2-4616-8368-08a473e078a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:50.708315 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da68f81d-10e2-4616-8368-08a473e078a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:50.709010 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da68f81d-10e2-4616-8368-08a473e078a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:50.709472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da68f81d-10e2-4616-8368-08a473e078a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:50.709901 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da68f81d-10e2-4616-8368-08a473e078a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:50.837365 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-da68f81d-10e2-4616-8368-08a473e078a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:50.845888 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-da68f81d-10e2-4616-8368-08a473e078a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:50.847374 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-da68f81d-10e2-4616-8368-08a473e078a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:50.848530 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-da68f81d-10e2-4616-8368-08a473e078a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.152549 Sep 16 08:09:50.849117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 322/606] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:50 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:51.251171 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f05d3fa8-194c-4ebf-9932-b261afc9e2c7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:51.251779 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f05d3fa8-194c-4ebf-9932-b261afc9e2c7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:51.257783 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f05d3fa8-194c-4ebf-9932-b261afc9e2c7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:51.258268 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f05d3fa8-194c-4ebf-9932-b261afc9e2c7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:51.258731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f05d3fa8-194c-4ebf-9932-b261afc9e2c7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:51.259430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f05d3fa8-194c-4ebf-9932-b261afc9e2c7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:51.259883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f05d3fa8-194c-4ebf-9932-b261afc9e2c7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:51.260314 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f05d3fa8-194c-4ebf-9932-b261afc9e2c7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:51.389392 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f05d3fa8-194c-4ebf-9932-b261afc9e2c7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:51.397110 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f05d3fa8-194c-4ebf-9932-b261afc9e2c7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.149971 Sep 16 08:09:51.397675 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 285/607] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:51 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:51.729332 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5e5a7299-bb28-4d04-9832-20b1f29f72fe tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:51.729945 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5e5a7299-bb28-4d04-9832-20b1f29f72fe tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:51.736366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e5a7299-bb28-4d04-9832-20b1f29f72fe tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:51.736859 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e5a7299-bb28-4d04-9832-20b1f29f72fe tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:51.737326 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e5a7299-bb28-4d04-9832-20b1f29f72fe tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:51.738058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e5a7299-bb28-4d04-9832-20b1f29f72fe tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:51.738547 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e5a7299-bb28-4d04-9832-20b1f29f72fe tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:51.739018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e5a7299-bb28-4d04-9832-20b1f29f72fe tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:51.871679 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5e5a7299-bb28-4d04-9832-20b1f29f72fe tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:51.874320 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1614280e-cafe-46a5-9fd3-43d26429bc61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:51.874989 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1614280e-cafe-46a5-9fd3-43d26429bc61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:51.880294 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5e5a7299-bb28-4d04-9832-20b1f29f72fe tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.154790 Sep 16 08:09:51.880867 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 323/608] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:51 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:51.881531 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1614280e-cafe-46a5-9fd3-43d26429bc61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:51.882019 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1614280e-cafe-46a5-9fd3-43d26429bc61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:51.882464 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1614280e-cafe-46a5-9fd3-43d26429bc61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:51.883194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1614280e-cafe-46a5-9fd3-43d26429bc61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:51.883652 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1614280e-cafe-46a5-9fd3-43d26429bc61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:51.884083 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1614280e-cafe-46a5-9fd3-43d26429bc61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:52.011268 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1614280e-cafe-46a5-9fd3-43d26429bc61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:52.019956 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1614280e-cafe-46a5-9fd3-43d26429bc61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:52.021401 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1614280e-cafe-46a5-9fd3-43d26429bc61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:52.022544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1614280e-cafe-46a5-9fd3-43d26429bc61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.152267 Sep 16 08:09:52.023145 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 286/609] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:51 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:52.419977 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-71f115a3-3b13-48f0-9a7b-58ec1757d68d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:52.420631 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-71f115a3-3b13-48f0-9a7b-58ec1757d68d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:52.426843 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-71f115a3-3b13-48f0-9a7b-58ec1757d68d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:52.431938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-71f115a3-3b13-48f0-9a7b-58ec1757d68d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:52.431938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-71f115a3-3b13-48f0-9a7b-58ec1757d68d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:52.431938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-71f115a3-3b13-48f0-9a7b-58ec1757d68d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:52.431938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-71f115a3-3b13-48f0-9a7b-58ec1757d68d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:52.432314 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-71f115a3-3b13-48f0-9a7b-58ec1757d68d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:52.554144 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-71f115a3-3b13-48f0-9a7b-58ec1757d68d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:52.557612 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:52.562066 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-71f115a3-3b13-48f0-9a7b-58ec1757d68d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.146555 Sep 16 08:09:52.562634 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 324/610] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:52 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:52.904407 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7f40e1cc-b345-4c7d-bd90-602370c06666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:52.905010 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7f40e1cc-b345-4c7d-bd90-602370c06666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:52.911702 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7f40e1cc-b345-4c7d-bd90-602370c06666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:52.912176 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7f40e1cc-b345-4c7d-bd90-602370c06666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:52.912610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7f40e1cc-b345-4c7d-bd90-602370c06666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:52.913290 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7f40e1cc-b345-4c7d-bd90-602370c06666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:52.913739 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7f40e1cc-b345-4c7d-bd90-602370c06666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:52.914161 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7f40e1cc-b345-4c7d-bd90-602370c06666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:53.042607 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7f40e1cc-b345-4c7d-bd90-602370c06666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:53.049579 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-42163ea5-507d-4ee6-943d-b6251fa56ed0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:53.050288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-42163ea5-507d-4ee6-943d-b6251fa56ed0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:53.051684 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7f40e1cc-b345-4c7d-bd90-602370c06666 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.151659 Sep 16 08:09:53.052492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 287/611] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:52 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:53.058030 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-42163ea5-507d-4ee6-943d-b6251fa56ed0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:53.058589 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-42163ea5-507d-4ee6-943d-b6251fa56ed0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:53.059126 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-42163ea5-507d-4ee6-943d-b6251fa56ed0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:53.059905 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-42163ea5-507d-4ee6-943d-b6251fa56ed0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:53.060443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-42163ea5-507d-4ee6-943d-b6251fa56ed0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:53.061162 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-42163ea5-507d-4ee6-943d-b6251fa56ed0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:53.192575 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-42163ea5-507d-4ee6-943d-b6251fa56ed0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:53.202111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-42163ea5-507d-4ee6-943d-b6251fa56ed0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:53.209967 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-42163ea5-507d-4ee6-943d-b6251fa56ed0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:53.209967 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-42163ea5-507d-4ee6-943d-b6251fa56ed0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.159818 Sep 16 08:09:53.209967 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 325/612] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:53 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:53.596166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c2a12b76-4b8c-4eb1-a0e5-6065cf6a9f39 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:53.596695 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c2a12b76-4b8c-4eb1-a0e5-6065cf6a9f39 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:53.602783 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c2a12b76-4b8c-4eb1-a0e5-6065cf6a9f39 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:53.603787 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c2a12b76-4b8c-4eb1-a0e5-6065cf6a9f39 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:53.604224 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c2a12b76-4b8c-4eb1-a0e5-6065cf6a9f39 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:53.604916 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c2a12b76-4b8c-4eb1-a0e5-6065cf6a9f39 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:53.605400 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c2a12b76-4b8c-4eb1-a0e5-6065cf6a9f39 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:53.605825 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c2a12b76-4b8c-4eb1-a0e5-6065cf6a9f39 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:53.735266 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c2a12b76-4b8c-4eb1-a0e5-6065cf6a9f39 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:53.746747 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c2a12b76-4b8c-4eb1-a0e5-6065cf6a9f39 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.151021 Sep 16 08:09:53.746747 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 288/613] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:53 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:54.075548 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b948bc40-14dc-4938-907b-3780fde4e1af tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:54.076857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b948bc40-14dc-4938-907b-3780fde4e1af tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:54.082522 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b948bc40-14dc-4938-907b-3780fde4e1af tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:54.083045 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b948bc40-14dc-4938-907b-3780fde4e1af tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:54.083489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b948bc40-14dc-4938-907b-3780fde4e1af tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:54.084242 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b948bc40-14dc-4938-907b-3780fde4e1af tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:54.084701 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b948bc40-14dc-4938-907b-3780fde4e1af tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:54.085132 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b948bc40-14dc-4938-907b-3780fde4e1af tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:54.213220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b948bc40-14dc-4938-907b-3780fde4e1af tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:54.219203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b948bc40-14dc-4938-907b-3780fde4e1af tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.148079 Sep 16 08:09:54.219796 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 326/614] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:54 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:54.233083 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9ea8f5c2-c756-4338-b613-f7daf6726b2d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:54.233729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9ea8f5c2-c756-4338-b613-f7daf6726b2d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:54.240176 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9ea8f5c2-c756-4338-b613-f7daf6726b2d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:54.240658 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9ea8f5c2-c756-4338-b613-f7daf6726b2d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:54.241806 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9ea8f5c2-c756-4338-b613-f7daf6726b2d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:54.241806 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9ea8f5c2-c756-4338-b613-f7daf6726b2d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:54.242248 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9ea8f5c2-c756-4338-b613-f7daf6726b2d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:54.242728 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9ea8f5c2-c756-4338-b613-f7daf6726b2d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:54.367798 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9ea8f5c2-c756-4338-b613-f7daf6726b2d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:54.376466 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9ea8f5c2-c756-4338-b613-f7daf6726b2d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:54.377909 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9ea8f5c2-c756-4338-b613-f7daf6726b2d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:54.379095 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9ea8f5c2-c756-4338-b613-f7daf6726b2d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.149895 Sep 16 08:09:54.379660 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 289/615] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:54 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:54.765342 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-872cae99-1175-48cf-addf-61db2dd00c70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:54.766035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-872cae99-1175-48cf-addf-61db2dd00c70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:54.772032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-872cae99-1175-48cf-addf-61db2dd00c70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:54.772518 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-872cae99-1175-48cf-addf-61db2dd00c70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:54.772961 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-872cae99-1175-48cf-addf-61db2dd00c70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:54.773638 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-872cae99-1175-48cf-addf-61db2dd00c70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:54.774089 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-872cae99-1175-48cf-addf-61db2dd00c70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:54.774511 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-872cae99-1175-48cf-addf-61db2dd00c70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:54.904477 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-872cae99-1175-48cf-addf-61db2dd00c70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:54.912324 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-872cae99-1175-48cf-addf-61db2dd00c70 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.150865 Sep 16 08:09:54.912878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 327/616] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:54 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:55.241465 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-dfb62bf0-5152-4747-aed1-acdf44c0e46e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:55.242234 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-dfb62bf0-5152-4747-aed1-acdf44c0e46e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:55.250018 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dfb62bf0-5152-4747-aed1-acdf44c0e46e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:55.250513 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dfb62bf0-5152-4747-aed1-acdf44c0e46e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:55.251058 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dfb62bf0-5152-4747-aed1-acdf44c0e46e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:55.251763 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dfb62bf0-5152-4747-aed1-acdf44c0e46e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:55.252255 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dfb62bf0-5152-4747-aed1-acdf44c0e46e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:55.252688 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dfb62bf0-5152-4747-aed1-acdf44c0e46e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:55.299156 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-dd783ab2-3863-47a3-84ba-82a1e53c9aed req-04f2e007-82af-4e44-bcfb-421e116507d8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea13dc92-1066-46f6-9fda-8d87d3721731", "name": "network-vif-plugged", "status": "completed", "tag": "5b2d3958-4467-4e0e-8120-6287840453ee"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:55.304165 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-dd783ab2-3863-47a3-84ba-82a1e53c9aed req-04f2e007-82af-4e44-bcfb-421e116507d8 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:55.304675 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-dd783ab2-3863-47a3-84ba-82a1e53c9aed req-04f2e007-82af-4e44-bcfb-421e116507d8 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:55.305086 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-dd783ab2-3863-47a3-84ba-82a1e53c9aed req-04f2e007-82af-4e44-bcfb-421e116507d8 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:55.322584 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-dd783ab2-3863-47a3-84ba-82a1e53c9aed req-04f2e007-82af-4e44-bcfb-421e116507d8 service nova] Creating event network-vif-plugged:5b2d3958-4467-4e0e-8120-6287840453ee for instance ea13dc92-1066-46f6-9fda-8d87d3721731 on hv-cinder-74014 Sep 16 08:09:55.323240 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-dd783ab2-3863-47a3-84ba-82a1e53c9aed req-04f2e007-82af-4e44-bcfb-421e116507d8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033169 Sep 16 08:09:55.323844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 328/617] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:09:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:09:55.391032 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dfb62bf0-5152-4747-aed1-acdf44c0e46e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:55.399719 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-dfb62bf0-5152-4747-aed1-acdf44c0e46e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.161869 Sep 16 08:09:55.406060 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-64ff5450-e180-4758-b49a-1400cac00243 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:55.408632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-64ff5450-e180-4758-b49a-1400cac00243 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:55.409526 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 290/618] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:55 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:55.413291 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-64ff5450-e180-4758-b49a-1400cac00243 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:55.414011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-64ff5450-e180-4758-b49a-1400cac00243 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:55.414661 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-64ff5450-e180-4758-b49a-1400cac00243 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:55.415410 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-64ff5450-e180-4758-b49a-1400cac00243 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:55.415879 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-64ff5450-e180-4758-b49a-1400cac00243 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:55.416376 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-64ff5450-e180-4758-b49a-1400cac00243 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:55.547831 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-64ff5450-e180-4758-b49a-1400cac00243 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:55.556813 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-64ff5450-e180-4758-b49a-1400cac00243 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:55.558252 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-64ff5450-e180-4758-b49a-1400cac00243 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:55.559437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-64ff5450-e180-4758-b49a-1400cac00243 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.158082 Sep 16 08:09:55.560003 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 329/619] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:55 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:09:55.935308 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-da7b01c2-fd8a-4e56-a8c6-d727624cc4b5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:55.935918 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-da7b01c2-fd8a-4e56-a8c6-d727624cc4b5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:55.941877 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-da7b01c2-fd8a-4e56-a8c6-d727624cc4b5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:55.942367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-da7b01c2-fd8a-4e56-a8c6-d727624cc4b5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:55.942833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-da7b01c2-fd8a-4e56-a8c6-d727624cc4b5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:55.943520 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-da7b01c2-fd8a-4e56-a8c6-d727624cc4b5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:55.943975 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-da7b01c2-fd8a-4e56-a8c6-d727624cc4b5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:55.944405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-da7b01c2-fd8a-4e56-a8c6-d727624cc4b5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:56.067631 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-da7b01c2-fd8a-4e56-a8c6-d727624cc4b5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:56.075300 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-da7b01c2-fd8a-4e56-a8c6-d727624cc4b5 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.144466 Sep 16 08:09:56.075863 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 291/620] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:55 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:56.423173 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7b98a328-46e5-4bed-a45a-a500bd867787 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:56.423773 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7b98a328-46e5-4bed-a45a-a500bd867787 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:56.430324 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b98a328-46e5-4bed-a45a-a500bd867787 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:56.431285 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b98a328-46e5-4bed-a45a-a500bd867787 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:56.431285 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b98a328-46e5-4bed-a45a-a500bd867787 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:56.431947 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b98a328-46e5-4bed-a45a-a500bd867787 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:56.432400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b98a328-46e5-4bed-a45a-a500bd867787 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:56.432823 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b98a328-46e5-4bed-a45a-a500bd867787 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:56.560369 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7b98a328-46e5-4bed-a45a-a500bd867787 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:56.568552 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7b98a328-46e5-4bed-a45a-a500bd867787 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.149227 Sep 16 08:09:56.569114 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 330/621] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:56 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:56.585254 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6834a23f-c0fe-4dcb-afa1-6fcac8b43821 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:56.585893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6834a23f-c0fe-4dcb-afa1-6fcac8b43821 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:56.592832 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6834a23f-c0fe-4dcb-afa1-6fcac8b43821 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:56.593312 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6834a23f-c0fe-4dcb-afa1-6fcac8b43821 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:56.593752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6834a23f-c0fe-4dcb-afa1-6fcac8b43821 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:56.594442 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6834a23f-c0fe-4dcb-afa1-6fcac8b43821 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:56.594999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6834a23f-c0fe-4dcb-afa1-6fcac8b43821 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:56.595428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6834a23f-c0fe-4dcb-afa1-6fcac8b43821 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:56.751901 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6834a23f-c0fe-4dcb-afa1-6fcac8b43821 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:56.761164 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6834a23f-c0fe-4dcb-afa1-6fcac8b43821 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:56.762732 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6834a23f-c0fe-4dcb-afa1-6fcac8b43821 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:56.763890 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6834a23f-c0fe-4dcb-afa1-6fcac8b43821 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.182566 Sep 16 08:09:56.764448 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 292/622] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:56 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 184 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:57.097495 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-243a22a8-a8d0-4c85-aef8-731738de3c14 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:57.098108 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-243a22a8-a8d0-4c85-aef8-731738de3c14 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:57.105583 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-243a22a8-a8d0-4c85-aef8-731738de3c14 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:57.106080 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-243a22a8-a8d0-4c85-aef8-731738de3c14 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:57.106658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-243a22a8-a8d0-4c85-aef8-731738de3c14 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:57.107390 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-243a22a8-a8d0-4c85-aef8-731738de3c14 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:57.107848 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-243a22a8-a8d0-4c85-aef8-731738de3c14 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:57.108711 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-243a22a8-a8d0-4c85-aef8-731738de3c14 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:57.247724 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-243a22a8-a8d0-4c85-aef8-731738de3c14 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:57.255332 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-243a22a8-a8d0-4c85-aef8-731738de3c14 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.161855 Sep 16 08:09:57.255900 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 331/623] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:57 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:57.591909 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7210c3bf-eda3-44db-b3af-2682d93cf397 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:57.592512 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7210c3bf-eda3-44db-b3af-2682d93cf397 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:57.598942 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7210c3bf-eda3-44db-b3af-2682d93cf397 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:57.599427 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7210c3bf-eda3-44db-b3af-2682d93cf397 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:57.599963 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7210c3bf-eda3-44db-b3af-2682d93cf397 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:57.600652 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7210c3bf-eda3-44db-b3af-2682d93cf397 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:57.601102 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7210c3bf-eda3-44db-b3af-2682d93cf397 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:57.601524 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7210c3bf-eda3-44db-b3af-2682d93cf397 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:57.728869 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7210c3bf-eda3-44db-b3af-2682d93cf397 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:57.732385 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=100 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:57.737507 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7210c3bf-eda3-44db-b3af-2682d93cf397 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1734 microversion: 2.1 time: 0.149522 Sep 16 08:09:57.738073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 293/624] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:57 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1734 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:57.789022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a997ab3d-54be-4bd9-bb9f-83c3655e8302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:57.789630 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a997ab3d-54be-4bd9-bb9f-83c3655e8302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:57.796891 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a997ab3d-54be-4bd9-bb9f-83c3655e8302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:57.797371 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a997ab3d-54be-4bd9-bb9f-83c3655e8302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:57.797811 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a997ab3d-54be-4bd9-bb9f-83c3655e8302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:57.798501 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a997ab3d-54be-4bd9-bb9f-83c3655e8302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:57.798991 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a997ab3d-54be-4bd9-bb9f-83c3655e8302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:57.799446 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a997ab3d-54be-4bd9-bb9f-83c3655e8302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:57.929487 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a997ab3d-54be-4bd9-bb9f-83c3655e8302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:57.938469 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a997ab3d-54be-4bd9-bb9f-83c3655e8302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:57.939950 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a997ab3d-54be-4bd9-bb9f-83c3655e8302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:57.941123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a997ab3d-54be-4bd9-bb9f-83c3655e8302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.156116 Sep 16 08:09:57.941681 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 332/625] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:57 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:58.279092 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-8dbc60f3-9fcc-4261-850e-13b504204127 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:58.279650 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-8dbc60f3-9fcc-4261-850e-13b504204127 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:58.285858 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8dbc60f3-9fcc-4261-850e-13b504204127 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:58.286345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8dbc60f3-9fcc-4261-850e-13b504204127 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:58.286805 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8dbc60f3-9fcc-4261-850e-13b504204127 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:58.287492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8dbc60f3-9fcc-4261-850e-13b504204127 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:58.287943 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8dbc60f3-9fcc-4261-850e-13b504204127 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:58.288369 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8dbc60f3-9fcc-4261-850e-13b504204127 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:58.412979 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-8dbc60f3-9fcc-4261-850e-13b504204127 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:58.420484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-8dbc60f3-9fcc-4261-850e-13b504204127 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1366 microversion: 2.1 time: 0.145768 Sep 16 08:09:58.421070 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 294/626] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:58 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1366 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:58.760666 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1316a931-c818-45c6-ac54-2ed1256be04f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:58.761310 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1316a931-c818-45c6-ac54-2ed1256be04f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:58.763281 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=92,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:09:58.767827 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1316a931-c818-45c6-ac54-2ed1256be04f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:58.768305 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1316a931-c818-45c6-ac54-2ed1256be04f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:58.768738 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1316a931-c818-45c6-ac54-2ed1256be04f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:58.769418 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1316a931-c818-45c6-ac54-2ed1256be04f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:58.769869 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1316a931-c818-45c6-ac54-2ed1256be04f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:58.770288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1316a931-c818-45c6-ac54-2ed1256be04f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:58.903919 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1316a931-c818-45c6-ac54-2ed1256be04f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:58.913172 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1316a931-c818-45c6-ac54-2ed1256be04f tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1714 microversion: 2.1 time: 0.156243 Sep 16 08:09:58.913908 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 333/627] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:58 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1714 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:58.967213 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3fb9a4c0-bf0e-4d1f-8182-978eb81c19b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:58.968636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3fb9a4c0-bf0e-4d1f-8182-978eb81c19b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:58.975027 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3fb9a4c0-bf0e-4d1f-8182-978eb81c19b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:58.975755 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3fb9a4c0-bf0e-4d1f-8182-978eb81c19b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:58.976254 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3fb9a4c0-bf0e-4d1f-8182-978eb81c19b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:58.977279 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3fb9a4c0-bf0e-4d1f-8182-978eb81c19b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:58.977736 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3fb9a4c0-bf0e-4d1f-8182-978eb81c19b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:58.978747 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3fb9a4c0-bf0e-4d1f-8182-978eb81c19b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:59.032343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ac00ee50-f0e8-42ce-962a-c0bbb352de9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:59.039334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ac00ee50-f0e8-42ce-962a-c0bbb352de9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:59.039334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ac00ee50-f0e8-42ce-962a-c0bbb352de9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:59.039543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ac00ee50-f0e8-42ce-962a-c0bbb352de9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:59.040043 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ac00ee50-f0e8-42ce-962a-c0bbb352de9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:59.041291 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ac00ee50-f0e8-42ce-962a-c0bbb352de9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:59.041755 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ac00ee50-f0e8-42ce-962a-c0bbb352de9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:59.042208 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ac00ee50-f0e8-42ce-962a-c0bbb352de9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:59.120638 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3fb9a4c0-bf0e-4d1f-8182-978eb81c19b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:59.129646 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3fb9a4c0-bf0e-4d1f-8182-978eb81c19b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:59.131120 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3fb9a4c0-bf0e-4d1f-8182-978eb81c19b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:59.132288 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3fb9a4c0-bf0e-4d1f-8182-978eb81c19b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.170443 Sep 16 08:09:59.132856 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 295/628] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:09:58 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:09:59.180847 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-ac00ee50-f0e8-42ce-962a-c0bbb352de9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] HTTP exception thrown: Cannot 'detach_volume' instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b while it is in vm_state rescued Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ac00ee50-f0e8-42ce-962a-c0bbb352de9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Request method failure captured: Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: DELETE /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments/b6cc13a8-8428-4403-ae39-f49efdfcbcf3 HTTP/1.1 Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5GXkI7GeumBIhNBFf_vC-zlSOiV4dCShrtm4bkI4LE1i-bWnSTTdrg8lDXop79dMBvn6k727VeIZ9RUTBYYG88b4loy74GTRNMsNeOg1LluL0TmiejGYMmPZSLUag59Xa3AoJLUqBLHggHqVQT8xsY47QGvGbWk6SSJElkQSuFN5w Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: f143f731c6cc4b38ba979827cd390f77 Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:09:59.183058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:09:59.184699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f143f731c6cc4b38ba979827cd390f77", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:09:59.184699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:09:59.184699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: f143f731c6cc4b38ba979827cd390f77 Sep 16 08:09:59.184699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:09:59.184699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-ServerRescueNegativeTestJSON-481869959-project Sep 16 08:09:59.184699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:09:59.184699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:09:59.184699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: 5a85cff936184b5d94375fd103493950 Sep 16 08:09:59.184699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-ServerRescueNegativeTestJSON-481869959-project Sep 16 08:09:59.184699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:09:59.184699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Cannot 'detach_volume' instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b while it is in vm_state rescued Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'server_id': '5e79005e-be5d-4326-aa8d-28bdef7f1a3b', 'id': 'b6cc13a8-8428-4403-ae39-f49efdfcbcf3'} Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 565, in delete Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi self.compute_api.detach_volume(context, instance, volume) Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 148, in inner Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceInvalidState( Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceInvalidState: Instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b in vm_state rescued. Cannot detach_volume while the instance is in this state. Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:09:59.185562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 573, in delete Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi common.raise_http_conflict_for_instance_invalid_state(state_error, Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 347, in raise_http_conflict_for_instance_invalid_state Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise webob.exc.HTTPConflict(explanation=msg) Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPConflict: Cannot 'detach_volume' instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b while it is in vm_state rescued Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Cannot 'detach_volume' instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b while it is in vm_state rescued Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:09:59.187032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ac00ee50-f0e8-42ce-962a-c0bbb352de9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Returning 409 to user: Cannot 'detach_volume' instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b while it is in vm_state rescued {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:09:59.188386 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ac00ee50-f0e8-42ce-962a-c0bbb352de9c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments/b6cc13a8-8428-4403-ae39-f49efdfcbcf3" status: 409 len: 152 microversion: 2.1 time: 0.156727 Sep 16 08:09:59.188386 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 334/629] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Sep 16 08:09:59 2022] DELETE /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments/b6cc13a8-8428-4403-ae39-f49efdfcbcf3 => generated 152 bytes in 158 msecs (HTTP/1.1 409) 9 headers in 378 bytes (2 switches on core 0) Sep 16 08:09:59.193341 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-09f159d6-3fbb-4da2-a0c4-7830d1144549 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Action: 'action', calling method: >, body: {"unrescue": {}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:59.193861 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-09f159d6-3fbb-4da2-a0c4-7830d1144549 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:59.200411 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-09f159d6-3fbb-4da2-a0c4-7830d1144549 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:59.200970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-09f159d6-3fbb-4da2-a0c4-7830d1144549 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:59.201426 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-09f159d6-3fbb-4da2-a0c4-7830d1144549 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:59.202306 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-09f159d6-3fbb-4da2-a0c4-7830d1144549 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:59.202796 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-09f159d6-3fbb-4da2-a0c4-7830d1144549 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:59.203225 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-09f159d6-3fbb-4da2-a0c4-7830d1144549 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:59.242178 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-b1bb8aa5-f890-4dd2-bf73-f05382c3b79e req-6e0a103c-055a-4232-bd0c-dca42cba35a5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c", "name": "network-vif-plugged", "status": "completed", "tag": "0104ad2b-b1c9-455f-a512-cdc1dd34408e"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:09:59.253161 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b1bb8aa5-f890-4dd2-bf73-f05382c3b79e req-6e0a103c-055a-4232-bd0c-dca42cba35a5 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:59.253639 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b1bb8aa5-f890-4dd2-bf73-f05382c3b79e req-6e0a103c-055a-4232-bd0c-dca42cba35a5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:59.254071 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b1bb8aa5-f890-4dd2-bf73-f05382c3b79e req-6e0a103c-055a-4232-bd0c-dca42cba35a5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:59.264895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-b1bb8aa5-f890-4dd2-bf73-f05382c3b79e req-6e0a103c-055a-4232-bd0c-dca42cba35a5 service nova] Creating event network-vif-plugged:0104ad2b-b1c9-455f-a512-cdc1dd34408e for instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c on hv-cinder-74014 Sep 16 08:09:59.269981 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-b1bb8aa5-f890-4dd2-bf73-f05382c3b79e req-6e0a103c-055a-4232-bd0c-dca42cba35a5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031767 Sep 16 08:09:59.270543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 335/630] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:09:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:09:59.387724 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-09f159d6-3fbb-4da2-a0c4-7830d1144549 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "POST /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/action" status: 202 len: 0 microversion: 2.1 time: 0.198065 Sep 16 08:09:59.388361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 296/631] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:09:59 2022] POST /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/action => generated 0 bytes in 199 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:09:59.396977 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-93d1e49a-97c6-475b-a097-5fa4575177e8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:59.397672 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-93d1e49a-97c6-475b-a097-5fa4575177e8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:59.403796 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93d1e49a-97c6-475b-a097-5fa4575177e8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:59.404282 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93d1e49a-97c6-475b-a097-5fa4575177e8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:59.404700 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93d1e49a-97c6-475b-a097-5fa4575177e8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:59.405646 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93d1e49a-97c6-475b-a097-5fa4575177e8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:59.406187 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93d1e49a-97c6-475b-a097-5fa4575177e8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:59.406614 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93d1e49a-97c6-475b-a097-5fa4575177e8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:59.443733 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4efd6aad-929a-456f-96bc-0adea62f6c29 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:59.444532 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4efd6aad-929a-456f-96bc-0adea62f6c29 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:59.450803 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4efd6aad-929a-456f-96bc-0adea62f6c29 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:59.451358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4efd6aad-929a-456f-96bc-0adea62f6c29 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:59.451799 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4efd6aad-929a-456f-96bc-0adea62f6c29 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:59.452494 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4efd6aad-929a-456f-96bc-0adea62f6c29 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:59.452942 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4efd6aad-929a-456f-96bc-0adea62f6c29 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:59.453364 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4efd6aad-929a-456f-96bc-0adea62f6c29 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:59.547344 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-93d1e49a-97c6-475b-a097-5fa4575177e8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:59.556025 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-93d1e49a-97c6-475b-a097-5fa4575177e8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1722 microversion: 2.1 time: 0.163167 Sep 16 08:09:59.557240 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 336/632] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:59 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1722 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:09:59.599134 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-4efd6aad-929a-456f-96bc-0adea62f6c29 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:09:59.604742 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4efd6aad-929a-456f-96bc-0adea62f6c29 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1556 microversion: 2.1 time: 0.165252 Sep 16 08:09:59.605304 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 297/633] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:09:59 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1556 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:09:59.627237 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6a06a513-36b1-41c5-aeec-d9d4b30a488e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:09:59.628075 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6a06a513-36b1-41c5-aeec-d9d4b30a488e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:09:59.633511 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6a06a513-36b1-41c5-aeec-d9d4b30a488e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:59.633992 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6a06a513-36b1-41c5-aeec-d9d4b30a488e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:59.634453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6a06a513-36b1-41c5-aeec-d9d4b30a488e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:59.635213 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6a06a513-36b1-41c5-aeec-d9d4b30a488e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:09:59.635645 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6a06a513-36b1-41c5-aeec-d9d4b30a488e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:09:59.636069 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6a06a513-36b1-41c5-aeec-d9d4b30a488e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:09:59.711970 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6a06a513-36b1-41c5-aeec-d9d4b30a488e tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.088496 Sep 16 08:09:59.713088 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 337/634] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Sep 16 08:09:59 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-interface => generated 285 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:00.158874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a969488b-8956-4da1-bf29-8af64143bc97 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:00.160600 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a969488b-8956-4da1-bf29-8af64143bc97 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:00.167739 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a969488b-8956-4da1-bf29-8af64143bc97 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:00.168224 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a969488b-8956-4da1-bf29-8af64143bc97 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:00.168749 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a969488b-8956-4da1-bf29-8af64143bc97 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:00.169484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a969488b-8956-4da1-bf29-8af64143bc97 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:00.169935 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a969488b-8956-4da1-bf29-8af64143bc97 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:00.170356 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a969488b-8956-4da1-bf29-8af64143bc97 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:00.353256 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a969488b-8956-4da1-bf29-8af64143bc97 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:00.361849 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a969488b-8956-4da1-bf29-8af64143bc97 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:00.363317 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a969488b-8956-4da1-bf29-8af64143bc97 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:00.364479 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a969488b-8956-4da1-bf29-8af64143bc97 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.209834 Sep 16 08:10:00.365034 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 298/635] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:00 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:10:00.580557 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-04a73ae9-6fa4-40eb-b7eb-e2c67826b234 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:00.581093 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-04a73ae9-6fa4-40eb-b7eb-e2c67826b234 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:00.587086 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-04a73ae9-6fa4-40eb-b7eb-e2c67826b234 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:00.587606 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-04a73ae9-6fa4-40eb-b7eb-e2c67826b234 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:00.588050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-04a73ae9-6fa4-40eb-b7eb-e2c67826b234 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:00.588739 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-04a73ae9-6fa4-40eb-b7eb-e2c67826b234 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:00.589192 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-04a73ae9-6fa4-40eb-b7eb-e2c67826b234 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:00.589804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-04a73ae9-6fa4-40eb-b7eb-e2c67826b234 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:00.802657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-04a73ae9-6fa4-40eb-b7eb-e2c67826b234 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:00.810026 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-04a73ae9-6fa4-40eb-b7eb-e2c67826b234 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1722 microversion: 2.1 time: 0.233788 Sep 16 08:10:00.810734 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-fb1fd64d-621a-40e5-8584-d5f144022e01 req-d362408d-a3cb-4d78-9dd6-3104d1e7ab55 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ea13dc92-1066-46f6-9fda-8d87d3721731", "tag": "5b2d3958-4467-4e0e-8120-6287840453ee"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:00.810907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 338/636] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:00 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1722 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:00.820829 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-fb1fd64d-621a-40e5-8584-d5f144022e01 req-d362408d-a3cb-4d78-9dd6-3104d1e7ab55 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:00.821302 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-fb1fd64d-621a-40e5-8584-d5f144022e01 req-d362408d-a3cb-4d78-9dd6-3104d1e7ab55 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:00.822346 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-fb1fd64d-621a-40e5-8584-d5f144022e01 req-d362408d-a3cb-4d78-9dd6-3104d1e7ab55 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:00.833219 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-fb1fd64d-621a-40e5-8584-d5f144022e01 req-d362408d-a3cb-4d78-9dd6-3104d1e7ab55 service nova] Creating event network-changed:5b2d3958-4467-4e0e-8120-6287840453ee for instance ea13dc92-1066-46f6-9fda-8d87d3721731 on hv-cinder-74014 Sep 16 08:10:00.838054 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-fb1fd64d-621a-40e5-8584-d5f144022e01 req-d362408d-a3cb-4d78-9dd6-3104d1e7ab55 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031455 Sep 16 08:10:00.838631 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 299/637] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:10:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:10:01.389364 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-050de2dd-8823-46a4-8c66-594e69921d31 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:01.389975 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-050de2dd-8823-46a4-8c66-594e69921d31 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:01.395844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-050de2dd-8823-46a4-8c66-594e69921d31 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:01.396335 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-050de2dd-8823-46a4-8c66-594e69921d31 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:01.396772 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-050de2dd-8823-46a4-8c66-594e69921d31 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:01.397466 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-050de2dd-8823-46a4-8c66-594e69921d31 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:01.397924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-050de2dd-8823-46a4-8c66-594e69921d31 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:01.398351 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-050de2dd-8823-46a4-8c66-594e69921d31 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:01.540280 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-050de2dd-8823-46a4-8c66-594e69921d31 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:01.550275 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-050de2dd-8823-46a4-8c66-594e69921d31 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:01.551799 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-050de2dd-8823-46a4-8c66-594e69921d31 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:01.553242 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-050de2dd-8823-46a4-8c66-594e69921d31 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.167817 Sep 16 08:10:01.553850 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 339/638] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:01 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 169 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:10:01.834741 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0a5871f3-481a-44a5-b485-ae2ca99f72d8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:01.835450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0a5871f3-481a-44a5-b485-ae2ca99f72d8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:01.842465 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0a5871f3-481a-44a5-b485-ae2ca99f72d8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:01.843566 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0a5871f3-481a-44a5-b485-ae2ca99f72d8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:01.843566 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0a5871f3-481a-44a5-b485-ae2ca99f72d8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:01.844164 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0a5871f3-481a-44a5-b485-ae2ca99f72d8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:01.844617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0a5871f3-481a-44a5-b485-ae2ca99f72d8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:01.845044 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0a5871f3-481a-44a5-b485-ae2ca99f72d8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:01.977851 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0a5871f3-481a-44a5-b485-ae2ca99f72d8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:01.986079 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0a5871f3-481a-44a5-b485-ae2ca99f72d8 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1722 microversion: 2.1 time: 0.156224 Sep 16 08:10:01.986638 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 300/639] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:01 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1722 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:02.577887 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c298cc4f-027a-4d5f-9e5e-a822586e8ec9 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:02.578487 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c298cc4f-027a-4d5f-9e5e-a822586e8ec9 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:02.584969 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c298cc4f-027a-4d5f-9e5e-a822586e8ec9 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:02.585448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c298cc4f-027a-4d5f-9e5e-a822586e8ec9 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:02.585881 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c298cc4f-027a-4d5f-9e5e-a822586e8ec9 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:02.586566 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c298cc4f-027a-4d5f-9e5e-a822586e8ec9 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:02.587053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c298cc4f-027a-4d5f-9e5e-a822586e8ec9 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:02.587476 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c298cc4f-027a-4d5f-9e5e-a822586e8ec9 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:02.715413 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c298cc4f-027a-4d5f-9e5e-a822586e8ec9 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:02.723932 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c298cc4f-027a-4d5f-9e5e-a822586e8ec9 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:02.725391 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c298cc4f-027a-4d5f-9e5e-a822586e8ec9 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:02.726537 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c298cc4f-027a-4d5f-9e5e-a822586e8ec9 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.152576 Sep 16 08:10:02.727136 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 340/640] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:02 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:10:03.010605 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-8d0532a1-3f4e-41a4-913b-93d166911b1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:03.011259 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-8d0532a1-3f4e-41a4-913b-93d166911b1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:03.017669 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8d0532a1-3f4e-41a4-913b-93d166911b1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:03.018187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8d0532a1-3f4e-41a4-913b-93d166911b1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:03.018627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8d0532a1-3f4e-41a4-913b-93d166911b1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:03.019345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8d0532a1-3f4e-41a4-913b-93d166911b1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:03.019802 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8d0532a1-3f4e-41a4-913b-93d166911b1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:03.020232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8d0532a1-3f4e-41a4-913b-93d166911b1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:03.148261 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-8d0532a1-3f4e-41a4-913b-93d166911b1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:03.156646 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-8d0532a1-3f4e-41a4-913b-93d166911b1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1722 microversion: 2.1 time: 0.150668 Sep 16 08:10:03.157205 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 301/641] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:03 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1722 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:03.751051 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2f8ade5c-d1e1-4d62-b9e8-aa445f323159 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:03.755264 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2f8ade5c-d1e1-4d62-b9e8-aa445f323159 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:03.758204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2f8ade5c-d1e1-4d62-b9e8-aa445f323159 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:03.758709 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2f8ade5c-d1e1-4d62-b9e8-aa445f323159 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:03.759242 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2f8ade5c-d1e1-4d62-b9e8-aa445f323159 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:03.759934 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2f8ade5c-d1e1-4d62-b9e8-aa445f323159 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:03.760393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2f8ade5c-d1e1-4d62-b9e8-aa445f323159 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:03.760819 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2f8ade5c-d1e1-4d62-b9e8-aa445f323159 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:04.159185 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2f8ade5c-d1e1-4d62-b9e8-aa445f323159 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:04.168366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2f8ade5c-d1e1-4d62-b9e8-aa445f323159 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:04.170035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2f8ade5c-d1e1-4d62-b9e8-aa445f323159 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:04.171314 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2f8ade5c-d1e1-4d62-b9e8-aa445f323159 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1810 microversion: 2.20 time: 0.424254 Sep 16 08:10:04.171871 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 341/642] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:03 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1810 bytes in 425 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:10:04.180384 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-51ba6503-88cb-4e69-9aab-bdee92667137 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:04.181936 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-51ba6503-88cb-4e69-9aab-bdee92667137 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:04.188835 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51ba6503-88cb-4e69-9aab-bdee92667137 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:04.189367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51ba6503-88cb-4e69-9aab-bdee92667137 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:04.189791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51ba6503-88cb-4e69-9aab-bdee92667137 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:04.190525 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51ba6503-88cb-4e69-9aab-bdee92667137 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:04.191071 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51ba6503-88cb-4e69-9aab-bdee92667137 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:04.191511 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-51ba6503-88cb-4e69-9aab-bdee92667137 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:04.322959 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-51ba6503-88cb-4e69-9aab-bdee92667137 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:04.331286 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-51ba6503-88cb-4e69-9aab-bdee92667137 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1722 microversion: 2.1 time: 0.155096 Sep 16 08:10:04.331846 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 302/643] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:04 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1722 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:05.196208 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-50adeb2d-f28c-4088-9724-8a0768c270f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:05.196822 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-50adeb2d-f28c-4088-9724-8a0768c270f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:05.203297 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-50adeb2d-f28c-4088-9724-8a0768c270f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:05.203790 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-50adeb2d-f28c-4088-9724-8a0768c270f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:05.204231 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-50adeb2d-f28c-4088-9724-8a0768c270f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:05.204921 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-50adeb2d-f28c-4088-9724-8a0768c270f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:05.205381 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-50adeb2d-f28c-4088-9724-8a0768c270f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:05.205846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-50adeb2d-f28c-4088-9724-8a0768c270f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:05.341347 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-50adeb2d-f28c-4088-9724-8a0768c270f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:05.349868 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-50adeb2d-f28c-4088-9724-8a0768c270f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:05.351356 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-50adeb2d-f28c-4088-9724-8a0768c270f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:05.352513 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-50adeb2d-f28c-4088-9724-8a0768c270f1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1797 microversion: 2.20 time: 0.160193 Sep 16 08:10:05.353073 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 342/644] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:05 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1797 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:10:05.354667 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fb99d756-1357-4df1-b9fb-85c1db9c1479 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:05.357453 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-fb99d756-1357-4df1-b9fb-85c1db9c1479 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:05.361912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb99d756-1357-4df1-b9fb-85c1db9c1479 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:05.362391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb99d756-1357-4df1-b9fb-85c1db9c1479 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:05.362940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb99d756-1357-4df1-b9fb-85c1db9c1479 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:05.363642 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb99d756-1357-4df1-b9fb-85c1db9c1479 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:05.364100 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb99d756-1357-4df1-b9fb-85c1db9c1479 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:05.364530 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb99d756-1357-4df1-b9fb-85c1db9c1479 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:05.489946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fb99d756-1357-4df1-b9fb-85c1db9c1479 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:05.498705 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-fb99d756-1357-4df1-b9fb-85c1db9c1479 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1728 microversion: 2.1 time: 0.147888 Sep 16 08:10:05.499263 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 303/645] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:05 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1728 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:10:05.520576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-442cec22-4245-4de0-9d65-c4f7626a1b03 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:05.521072 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-442cec22-4245-4de0-9d65-c4f7626a1b03 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:05.527009 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-442cec22-4245-4de0-9d65-c4f7626a1b03 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:05.527497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-442cec22-4245-4de0-9d65-c4f7626a1b03 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:05.527938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-442cec22-4245-4de0-9d65-c4f7626a1b03 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:05.528628 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-442cec22-4245-4de0-9d65-c4f7626a1b03 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:05.529115 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-442cec22-4245-4de0-9d65-c4f7626a1b03 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:05.529546 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-442cec22-4245-4de0-9d65-c4f7626a1b03 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:05.533473 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:05.605979 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-442cec22-4245-4de0-9d65-c4f7626a1b03 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089151 Sep 16 08:10:05.606571 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 343/646] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Sep 16 08:10:05 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-interface => generated 284 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:06.525017 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-8d28bda1-a699-47f5-9eb4-b958c433812d req-7535c72d-f63a-4abc-9ee1-7a03061ee128 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e79005e-be5d-4326-aa8d-28bdef7f1a3b", "tag": "e41ec44c-439a-45a5-9e2e-66947ff6004f"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:06.535943 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-8d28bda1-a699-47f5-9eb4-b958c433812d req-7535c72d-f63a-4abc-9ee1-7a03061ee128 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:06.536656 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-8d28bda1-a699-47f5-9eb4-b958c433812d req-7535c72d-f63a-4abc-9ee1-7a03061ee128 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:06.537086 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-8d28bda1-a699-47f5-9eb4-b958c433812d req-7535c72d-f63a-4abc-9ee1-7a03061ee128 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:06.550800 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-8d28bda1-a699-47f5-9eb4-b958c433812d req-7535c72d-f63a-4abc-9ee1-7a03061ee128 service nova] Creating event network-changed:e41ec44c-439a-45a5-9e2e-66947ff6004f for instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b on hv-cinder-74014 Sep 16 08:10:06.555973 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-8d28bda1-a699-47f5-9eb4-b958c433812d req-7535c72d-f63a-4abc-9ee1-7a03061ee128 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034628 Sep 16 08:10:06.556755 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 304/647] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:10:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:06.883188 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5bb2ae7b-70b7-4bfa-a81c-1bc025ec21a1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Action: 'action', calling method: >, body: {"removeSecurityGroup": {"name": "tempest-secgroup-smoke-646625020"}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:06.883728 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5bb2ae7b-70b7-4bfa-a81c-1bc025ec21a1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:06.890861 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bb2ae7b-70b7-4bfa-a81c-1bc025ec21a1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:06.891359 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bb2ae7b-70b7-4bfa-a81c-1bc025ec21a1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:06.892001 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bb2ae7b-70b7-4bfa-a81c-1bc025ec21a1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:06.892735 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bb2ae7b-70b7-4bfa-a81c-1bc025ec21a1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:06.893194 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bb2ae7b-70b7-4bfa-a81c-1bc025ec21a1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:06.893804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bb2ae7b-70b7-4bfa-a81c-1bc025ec21a1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:07.094395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.network.security_group_api [None req-5bb2ae7b-70b7-4bfa-a81c-1bc025ec21a1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Removing security group 8c083c54-7d89-4592-bda5-0577f206bf4b from port 800c16c0-6c80-47ad-8a9f-a60246ce9a01 Sep 16 08:10:07.535757 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5bb2ae7b-70b7-4bfa-a81c-1bc025ec21a1 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "POST /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/action" status: 202 len: 0 microversion: 2.1 time: 0.656738 Sep 16 08:10:07.536475 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 344/648] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:10:06 2022] POST /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/action => generated 0 bytes in 658 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:10:08.769817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-b1e9902f-ca5c-4719-b626-8babcc9e1dd5 req-fe1cb730-e786-4841-b0d1-828fcb85eb02 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "5e79005e-be5d-4326-aa8d-28bdef7f1a3b", "tag": "e41ec44c-439a-45a5-9e2e-66947ff6004f"}, {"name": "network-changed", "server_uuid": "998c37d2-18ab-459f-a9d6-bf19c51fb695", "tag": "800c16c0-6c80-47ad-8a9f-a60246ce9a01"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:08.775341 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=75 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:08.781733 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-b1e9902f-ca5c-4719-b626-8babcc9e1dd5 req-fe1cb730-e786-4841-b0d1-828fcb85eb02 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:08.788554 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-b1e9902f-ca5c-4719-b626-8babcc9e1dd5 req-fe1cb730-e786-4841-b0d1-828fcb85eb02 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:08.788554 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-b1e9902f-ca5c-4719-b626-8babcc9e1dd5 req-fe1cb730-e786-4841-b0d1-828fcb85eb02 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:08.795310 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-b1e9902f-ca5c-4719-b626-8babcc9e1dd5 req-fe1cb730-e786-4841-b0d1-828fcb85eb02 service nova] Creating event network-changed:e41ec44c-439a-45a5-9e2e-66947ff6004f for instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b on hv-cinder-74014 Sep 16 08:10:08.795812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-b1e9902f-ca5c-4719-b626-8babcc9e1dd5 req-fe1cb730-e786-4841-b0d1-828fcb85eb02 service nova] Creating event network-changed:800c16c0-6c80-47ad-8a9f-a60246ce9a01 for instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 on hv-cinder-74014 Sep 16 08:10:08.802194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-b1e9902f-ca5c-4719-b626-8babcc9e1dd5 req-fe1cb730-e786-4841-b0d1-828fcb85eb02 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 346 microversion: 2.1 time: 0.036369 Sep 16 08:10:08.802800 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 305/649] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:10:08 2022] POST /compute/v2.1/os-server-external-events => generated 346 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:08.906105 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9edc66f5-6f3d-4338-9d89-4071c9b8e518 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:08.906670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-9edc66f5-6f3d-4338-9d89-4071c9b8e518 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:08.915802 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9edc66f5-6f3d-4338-9d89-4071c9b8e518 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:08.915802 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9edc66f5-6f3d-4338-9d89-4071c9b8e518 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:08.915802 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9edc66f5-6f3d-4338-9d89-4071c9b8e518 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:08.915802 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9edc66f5-6f3d-4338-9d89-4071c9b8e518 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:08.916372 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9edc66f5-6f3d-4338-9d89-4071c9b8e518 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:08.916372 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9edc66f5-6f3d-4338-9d89-4071c9b8e518 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:09.004788 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-9edc66f5-6f3d-4338-9d89-4071c9b8e518 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lazy-loading 'services' on Instance uuid 998c37d2-18ab-459f-a9d6-bf19c51fb695 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:10:09.239916 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9edc66f5-6f3d-4338-9d89-4071c9b8e518 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "DELETE /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments/263a4d0a-9657-4099-bf0b-8f0069b41ec7" status: 202 len: 0 microversion: 2.1 time: 0.338244 Sep 16 08:10:09.243611 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 345/650] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Sep 16 08:10:08 2022] DELETE /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments/263a4d0a-9657-4099-bf0b-8f0069b41ec7 => generated 0 bytes in 340 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:10:09.250033 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1582014c-4daf-4d6f-8b48-8c54c9329307 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:09.252352 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1582014c-4daf-4d6f-8b48-8c54c9329307 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:09.259517 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1582014c-4daf-4d6f-8b48-8c54c9329307 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:09.260048 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1582014c-4daf-4d6f-8b48-8c54c9329307 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:09.260701 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1582014c-4daf-4d6f-8b48-8c54c9329307 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:09.261615 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1582014c-4daf-4d6f-8b48-8c54c9329307 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:09.262088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1582014c-4daf-4d6f-8b48-8c54c9329307 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:09.262703 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1582014c-4daf-4d6f-8b48-8c54c9329307 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:09.295639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1582014c-4daf-4d6f-8b48-8c54c9329307 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.049840 Sep 16 08:10:09.296603 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 306/651] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:10:09 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:10.310209 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4c2da939-2fb6-4fd4-bdc2-19841abeeeac tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:10.312640 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4c2da939-2fb6-4fd4-bdc2-19841abeeeac tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:10.318783 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c2da939-2fb6-4fd4-bdc2-19841abeeeac tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:10.319272 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c2da939-2fb6-4fd4-bdc2-19841abeeeac tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:10.319705 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c2da939-2fb6-4fd4-bdc2-19841abeeeac tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:10.320392 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c2da939-2fb6-4fd4-bdc2-19841abeeeac tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:10.320846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c2da939-2fb6-4fd4-bdc2-19841abeeeac tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:10.321274 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c2da939-2fb6-4fd4-bdc2-19841abeeeac tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:10.350589 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4c2da939-2fb6-4fd4-bdc2-19841abeeeac tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045768 Sep 16 08:10:10.351172 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 346/652] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:10:10 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:10.818596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-4450539b-c2f0-4518-b5de-354205629eb9 req-4992f99f-fecc-4733-83f9-8e10c2b547b5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "998c37d2-18ab-459f-a9d6-bf19c51fb695", "tag": "800c16c0-6c80-47ad-8a9f-a60246ce9a01"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:10.828346 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-4450539b-c2f0-4518-b5de-354205629eb9 req-4992f99f-fecc-4733-83f9-8e10c2b547b5 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:10.828814 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-4450539b-c2f0-4518-b5de-354205629eb9 req-4992f99f-fecc-4733-83f9-8e10c2b547b5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:10.829240 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-4450539b-c2f0-4518-b5de-354205629eb9 req-4992f99f-fecc-4733-83f9-8e10c2b547b5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:10.840460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-4450539b-c2f0-4518-b5de-354205629eb9 req-4992f99f-fecc-4733-83f9-8e10c2b547b5 service nova] Creating event network-changed:800c16c0-6c80-47ad-8a9f-a60246ce9a01 for instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 on hv-cinder-74014 Sep 16 08:10:10.846347 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-4450539b-c2f0-4518-b5de-354205629eb9 req-4992f99f-fecc-4733-83f9-8e10c2b547b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031332 Sep 16 08:10:10.846978 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 307/653] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:10:10 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:11.362595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9e94cc2d-70d3-4e20-b290-31584e6719b9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:11.364949 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-9e94cc2d-70d3-4e20-b290-31584e6719b9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:11.373533 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9e94cc2d-70d3-4e20-b290-31584e6719b9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:11.373533 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9e94cc2d-70d3-4e20-b290-31584e6719b9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:11.373533 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9e94cc2d-70d3-4e20-b290-31584e6719b9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:11.373533 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9e94cc2d-70d3-4e20-b290-31584e6719b9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:11.374003 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9e94cc2d-70d3-4e20-b290-31584e6719b9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:11.374096 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9e94cc2d-70d3-4e20-b290-31584e6719b9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:11.403450 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9e94cc2d-70d3-4e20-b290-31584e6719b9 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044776 Sep 16 08:10:11.404021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 347/654] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:10:11 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments => generated 25 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 08:10:11.415384 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fd984390-86ad-4dce-9f21-9df1e7e44fce tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:11.415960 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-fd984390-86ad-4dce-9f21-9df1e7e44fce tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:11.422214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fd984390-86ad-4dce-9f21-9df1e7e44fce tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:11.422728 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fd984390-86ad-4dce-9f21-9df1e7e44fce tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:11.423166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fd984390-86ad-4dce-9f21-9df1e7e44fce tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:11.423846 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fd984390-86ad-4dce-9f21-9df1e7e44fce tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:11.424294 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fd984390-86ad-4dce-9f21-9df1e7e44fce tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:11.424716 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fd984390-86ad-4dce-9f21-9df1e7e44fce tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:11.497693 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-fd984390-86ad-4dce-9f21-9df1e7e44fce tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] HTTP exception thrown: Instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 is not attached to volume 263a4d0a-9657-4099-bf0b-8f0069b41ec7 Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fd984390-86ad-4dce-9f21-9df1e7e44fce tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Request method failure captured: Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: DELETE /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments/263a4d0a-9657-4099-bf0b-8f0069b41ec7 HTTP/1.1 Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC6bYdHwS--WA9o7PEqJXZRaGD-4Tj0yvvGUfZmH1meY1TsWXoVuxaMoKt3opCaYQ4EpseUKRkYRjqzvOtQ6h9qlI-sC1ZXyCuEdOYtHg_c1SIXTXc9wQz0VrM1oHmlVRdMSgmlYtocf0X8XwmUB3Qpq4TqlLnIxFnQoxB1kVQQ52Mw Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 5870af1bbad64b138178c47e4a571d81 Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-TestMinimumBasicScenario-31467956 Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:10:11.500119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:10:11.504405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5870af1bbad64b138178c47e4a571d81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5870af1bbad64b138178c47e4a571d81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5870af1bbad64b138178c47e4a571d81", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5870af1bbad64b138178c47e4a571d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:10:11.504405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-TestMinimumBasicScenario-31467956 Sep 16 08:10:11.504405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 5870af1bbad64b138178c47e4a571d81 Sep 16 08:10:11.504405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-TestMinimumBasicScenario-31467956 Sep 16 08:10:11.504405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-TestMinimumBasicScenario-31467956-project Sep 16 08:10:11.504405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:10:11.504405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:10:11.504405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: 66702831c1ca4158976920f6be2cc80c Sep 16 08:10:11.504405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-TestMinimumBasicScenario-31467956-project Sep 16 08:10:11.504405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:10:11.504405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 is not attached to volume 263a4d0a-9657-4099-bf0b-8f0069b41ec7 Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'server_id': '998c37d2-18ab-459f-a9d6-bf19c51fb695', 'id': '263a4d0a-9657-4099-bf0b-8f0069b41ec7'} Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 552, in delete Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi bdm = objects.BlockDeviceMapping.get_by_volume_and_instance( Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/oslo_versionedobjects/base.py", line 184, in wrapper Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi result = fn(cls, context, *args, **kwargs) Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/objects/block_device.py", line 293, in get_by_volume_and_instance Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.VolumeBDMNotFound(volume_id=volume_id) Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.VolumeBDMNotFound: No volume Block Device Mapping with id 263a4d0a-9657-4099-bf0b-8f0069b41ec7. Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:10:11.505267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 558, in delete Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=msg) Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 is not attached to volume 263a4d0a-9657-4099-bf0b-8f0069b41ec7 Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 is not attached to volume 263a4d0a-9657-4099-bf0b-8f0069b41ec7 Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:10:11.506636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fd984390-86ad-4dce-9f21-9df1e7e44fce tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Returning 404 to user: Instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 is not attached to volume 263a4d0a-9657-4099-bf0b-8f0069b41ec7 {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:10:11.507794 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-fd984390-86ad-4dce-9f21-9df1e7e44fce tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "DELETE /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments/263a4d0a-9657-4099-bf0b-8f0069b41ec7" status: 404 len: 154 microversion: 2.1 time: 0.090518 Sep 16 08:10:11.507794 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 308/655] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Sep 16 08:10:11 2022] DELETE /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695/os-volume_attachments/263a4d0a-9657-4099-bf0b-8f0069b41ec7 => generated 154 bytes in 92 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:10:12.734755 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cec62689-a645-4bcb-b790-796a52d2ea16 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:12.735265 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cec62689-a645-4bcb-b790-796a52d2ea16 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:12.742134 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cec62689-a645-4bcb-b790-796a52d2ea16 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:12.742134 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cec62689-a645-4bcb-b790-796a52d2ea16 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:12.742586 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cec62689-a645-4bcb-b790-796a52d2ea16 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:12.743323 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cec62689-a645-4bcb-b790-796a52d2ea16 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:12.743788 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cec62689-a645-4bcb-b790-796a52d2ea16 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:12.744716 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cec62689-a645-4bcb-b790-796a52d2ea16 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:12.769214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cec62689-a645-4bcb-b790-796a52d2ea16 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:10:12.860140 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f0e4fa82-2c60-49a1-99f2-f63f48cb5e9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:12.862313 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f0e4fa82-2c60-49a1-99f2-f63f48cb5e9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:12.868356 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0e4fa82-2c60-49a1-99f2-f63f48cb5e9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:12.868836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0e4fa82-2c60-49a1-99f2-f63f48cb5e9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:12.869802 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0e4fa82-2c60-49a1-99f2-f63f48cb5e9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:12.870499 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0e4fa82-2c60-49a1-99f2-f63f48cb5e9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:12.870983 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0e4fa82-2c60-49a1-99f2-f63f48cb5e9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:12.871414 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0e4fa82-2c60-49a1-99f2-f63f48cb5e9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:12.900048 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f0e4fa82-2c60-49a1-99f2-f63f48cb5e9f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044060 Sep 16 08:10:12.900672 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 309/656] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:10:12 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (2 switches on core 0) Sep 16 08:10:12.964216 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a25533b0-1cd0-49e3-9d5d-89c7c4bde69d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:12.964687 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a25533b0-1cd0-49e3-9d5d-89c7c4bde69d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:12.970602 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a25533b0-1cd0-49e3-9d5d-89c7c4bde69d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:12.971122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a25533b0-1cd0-49e3-9d5d-89c7c4bde69d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:12.971569 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a25533b0-1cd0-49e3-9d5d-89c7c4bde69d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:12.972263 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a25533b0-1cd0-49e3-9d5d-89c7c4bde69d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:12.972721 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a25533b0-1cd0-49e3-9d5d-89c7c4bde69d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:12.974559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a25533b0-1cd0-49e3-9d5d-89c7c4bde69d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:12.999212 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a25533b0-1cd0-49e3-9d5d-89c7c4bde69d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Going to try to terminate instance {{(pid=121047) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:10:13.076054 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cec62689-a645-4bcb-b790-796a52d2ea16 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "DELETE /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 204 len: 0 microversion: 2.1 time: 0.344834 Sep 16 08:10:13.076661 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 348/657] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:10:12 2022] DELETE /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 0 bytes in 346 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:10:13.085020 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-47f430d6-9ffe-4415-9259-d48dae20d571 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:13.085715 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-47f430d6-9ffe-4415-9259-d48dae20d571 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:13.091515 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-47f430d6-9ffe-4415-9259-d48dae20d571 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:13.091994 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-47f430d6-9ffe-4415-9259-d48dae20d571 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:13.092427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-47f430d6-9ffe-4415-9259-d48dae20d571 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:13.093118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-47f430d6-9ffe-4415-9259-d48dae20d571 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:13.093557 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-47f430d6-9ffe-4415-9259-d48dae20d571 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:13.093978 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-47f430d6-9ffe-4415-9259-d48dae20d571 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:13.111720 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:13.229988 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-47f430d6-9ffe-4415-9259-d48dae20d571 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:13.237738 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-47f430d6-9ffe-4415-9259-d48dae20d571 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1553 microversion: 2.1 time: 0.156752 Sep 16 08:10:13.238285 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 349/658] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:13 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1553 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:10:13.321407 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a25533b0-1cd0-49e3-9d5d-89c7c4bde69d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 204 len: 0 microversion: 2.1 time: 0.360735 Sep 16 08:10:13.321991 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 310/659] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:10:12 2022] DELETE /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 0 bytes in 362 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 08:10:13.329981 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a758642d-2373-4bec-8d78-07d6d00c1851 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:13.330625 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a758642d-2373-4bec-8d78-07d6d00c1851 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:13.336595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a758642d-2373-4bec-8d78-07d6d00c1851 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:13.337078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a758642d-2373-4bec-8d78-07d6d00c1851 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:13.337527 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a758642d-2373-4bec-8d78-07d6d00c1851 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:13.338707 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a758642d-2373-4bec-8d78-07d6d00c1851 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:13.339216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a758642d-2373-4bec-8d78-07d6d00c1851 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:13.339641 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a758642d-2373-4bec-8d78-07d6d00c1851 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:13.515791 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a758642d-2373-4bec-8d78-07d6d00c1851 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:13.523510 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a758642d-2373-4bec-8d78-07d6d00c1851 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1671 microversion: 2.1 time: 0.197323 Sep 16 08:10:13.524073 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 350/660] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:13 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1671 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:14.318329 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2d225dd8-c11c-4a98-bdba-665d575b3ffa tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:14.319050 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2d225dd8-c11c-4a98-bdba-665d575b3ffa tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:14.326232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2d225dd8-c11c-4a98-bdba-665d575b3ffa tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:14.326752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2d225dd8-c11c-4a98-bdba-665d575b3ffa tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:14.327192 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2d225dd8-c11c-4a98-bdba-665d575b3ffa tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:14.327884 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2d225dd8-c11c-4a98-bdba-665d575b3ffa tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:14.328439 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2d225dd8-c11c-4a98-bdba-665d575b3ffa tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:14.330342 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2d225dd8-c11c-4a98-bdba-665d575b3ffa tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:14.458283 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2d225dd8-c11c-4a98-bdba-665d575b3ffa tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:14.466749 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2d225dd8-c11c-4a98-bdba-665d575b3ffa tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1553 microversion: 2.1 time: 0.152669 Sep 16 08:10:14.467305 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 311/661] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:14 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1553 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:14.547491 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-427866e7-2940-4aec-9873-61f5990c3d3f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:14.548109 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-427866e7-2940-4aec-9873-61f5990c3d3f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:14.554583 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-427866e7-2940-4aec-9873-61f5990c3d3f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:14.555101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-427866e7-2940-4aec-9873-61f5990c3d3f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:14.555540 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-427866e7-2940-4aec-9873-61f5990c3d3f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:14.556230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-427866e7-2940-4aec-9873-61f5990c3d3f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:14.556688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-427866e7-2940-4aec-9873-61f5990c3d3f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:14.557119 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-427866e7-2940-4aec-9873-61f5990c3d3f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:14.686530 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-427866e7-2940-4aec-9873-61f5990c3d3f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:14.694185 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-427866e7-2940-4aec-9873-61f5990c3d3f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1671 microversion: 2.1 time: 0.150758 Sep 16 08:10:14.694764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 351/662] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:14 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1671 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:15.489544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5611056c-5561-4dab-9390-b828e1b76399 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:15.490170 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5611056c-5561-4dab-9390-b828e1b76399 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:15.496654 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5611056c-5561-4dab-9390-b828e1b76399 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:15.497183 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5611056c-5561-4dab-9390-b828e1b76399 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:15.497576 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5611056c-5561-4dab-9390-b828e1b76399 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:15.498268 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5611056c-5561-4dab-9390-b828e1b76399 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:15.498743 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5611056c-5561-4dab-9390-b828e1b76399 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:15.499171 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5611056c-5561-4dab-9390-b828e1b76399 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:15.627578 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5611056c-5561-4dab-9390-b828e1b76399 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:15.635120 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5611056c-5561-4dab-9390-b828e1b76399 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1553 microversion: 2.1 time: 0.149408 Sep 16 08:10:15.635686 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 312/663] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:15 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1553 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:15.717723 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5830acb4-66bf-40ee-ba9b-ce91127c5d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:15.718331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5830acb4-66bf-40ee-ba9b-ce91127c5d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:15.724812 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5830acb4-66bf-40ee-ba9b-ce91127c5d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:15.725296 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5830acb4-66bf-40ee-ba9b-ce91127c5d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:15.725733 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5830acb4-66bf-40ee-ba9b-ce91127c5d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:15.726421 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5830acb4-66bf-40ee-ba9b-ce91127c5d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:15.726905 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5830acb4-66bf-40ee-ba9b-ce91127c5d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:15.727327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5830acb4-66bf-40ee-ba9b-ce91127c5d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:15.853727 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5830acb4-66bf-40ee-ba9b-ce91127c5d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:15.861420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5830acb4-66bf-40ee-ba9b-ce91127c5d50 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1671 microversion: 2.1 time: 0.147995 Sep 16 08:10:15.861986 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 352/664] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:15 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1671 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:16.658018 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a5bc2e53-cae9-4fa9-831d-e11e69eb4483 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:16.658627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a5bc2e53-cae9-4fa9-831d-e11e69eb4483 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:16.665165 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5bc2e53-cae9-4fa9-831d-e11e69eb4483 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:16.665649 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5bc2e53-cae9-4fa9-831d-e11e69eb4483 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:16.666088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5bc2e53-cae9-4fa9-831d-e11e69eb4483 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:16.666810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5bc2e53-cae9-4fa9-831d-e11e69eb4483 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:16.667270 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5bc2e53-cae9-4fa9-831d-e11e69eb4483 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:16.667692 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5bc2e53-cae9-4fa9-831d-e11e69eb4483 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:16.841083 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a5bc2e53-cae9-4fa9-831d-e11e69eb4483 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:16.848776 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a5bc2e53-cae9-4fa9-831d-e11e69eb4483 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1553 microversion: 2.1 time: 0.194913 Sep 16 08:10:16.849338 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 313/665] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:16 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1553 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:16.884067 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ad7836b1-6078-4085-98c6-3712bb77ca45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:16.884683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ad7836b1-6078-4085-98c6-3712bb77ca45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:16.891011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ad7836b1-6078-4085-98c6-3712bb77ca45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:16.891500 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ad7836b1-6078-4085-98c6-3712bb77ca45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:16.891973 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ad7836b1-6078-4085-98c6-3712bb77ca45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:16.892663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ad7836b1-6078-4085-98c6-3712bb77ca45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:16.893119 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ad7836b1-6078-4085-98c6-3712bb77ca45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:16.893548 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ad7836b1-6078-4085-98c6-3712bb77ca45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:17.021505 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ad7836b1-6078-4085-98c6-3712bb77ca45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:17.029711 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ad7836b1-6078-4085-98c6-3712bb77ca45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1671 microversion: 2.1 time: 0.149424 Sep 16 08:10:17.030548 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 353/666] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:16 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1671 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:17.877840 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1438fa8f-5e29-45e7-9d8f-8a38ec50e858 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:17.877840 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1438fa8f-5e29-45e7-9d8f-8a38ec50e858 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:17.879836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1438fa8f-5e29-45e7-9d8f-8a38ec50e858 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:17.880429 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1438fa8f-5e29-45e7-9d8f-8a38ec50e858 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:17.880951 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1438fa8f-5e29-45e7-9d8f-8a38ec50e858 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:17.881713 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1438fa8f-5e29-45e7-9d8f-8a38ec50e858 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:17.882405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1438fa8f-5e29-45e7-9d8f-8a38ec50e858 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:17.882907 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1438fa8f-5e29-45e7-9d8f-8a38ec50e858 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:18.062193 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f462d5a2-8e00-41d0-bb08-a9f1baf0de45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:18.063514 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f462d5a2-8e00-41d0-bb08-a9f1baf0de45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:18.080460 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f462d5a2-8e00-41d0-bb08-a9f1baf0de45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:18.081348 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f462d5a2-8e00-41d0-bb08-a9f1baf0de45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:18.082136 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f462d5a2-8e00-41d0-bb08-a9f1baf0de45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:18.084407 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f462d5a2-8e00-41d0-bb08-a9f1baf0de45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:18.085480 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f462d5a2-8e00-41d0-bb08-a9f1baf0de45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:18.085663 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1438fa8f-5e29-45e7-9d8f-8a38ec50e858 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:18.086725 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f462d5a2-8e00-41d0-bb08-a9f1baf0de45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:18.096043 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1438fa8f-5e29-45e7-9d8f-8a38ec50e858 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1553 microversion: 2.1 time: 0.227817 Sep 16 08:10:18.101220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 314/667] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:17 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1553 bytes in 231 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:18.128175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-45e79fef-0151-4a33-9eab-7b381580c252 req-4b9ceeef-cdb4-4e63-91cb-ce78f27ed0af service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "998c37d2-18ab-459f-a9d6-bf19c51fb695", "name": "network-vif-deleted", "tag": "800c16c0-6c80-47ad-8a9f-a60246ce9a01"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:18.140487 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-45e79fef-0151-4a33-9eab-7b381580c252 req-4b9ceeef-cdb4-4e63-91cb-ce78f27ed0af service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:18.141026 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-45e79fef-0151-4a33-9eab-7b381580c252 req-4b9ceeef-cdb4-4e63-91cb-ce78f27ed0af service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:18.141474 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-45e79fef-0151-4a33-9eab-7b381580c252 req-4b9ceeef-cdb4-4e63-91cb-ce78f27ed0af service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:18.153542 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-45e79fef-0151-4a33-9eab-7b381580c252 req-4b9ceeef-cdb4-4e63-91cb-ce78f27ed0af service nova] Creating event network-vif-deleted:800c16c0-6c80-47ad-8a9f-a60246ce9a01 for instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 on hv-cinder-74014 Sep 16 08:10:18.158980 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-45e79fef-0151-4a33-9eab-7b381580c252 req-4b9ceeef-cdb4-4e63-91cb-ce78f27ed0af service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.040999 Sep 16 08:10:18.160062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 315/668] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:18.257425 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f462d5a2-8e00-41d0-bb08-a9f1baf0de45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:18.268621 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f462d5a2-8e00-41d0-bb08-a9f1baf0de45 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1671 microversion: 2.1 time: 0.217973 Sep 16 08:10:18.269798 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 354/669] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:18 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1671 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:18.796871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-2512cfdc-7c52-4ae2-bdad-712c526dd1f9 req-e1f8532f-ce92-405f-b6ce-9a018c646e11 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe69a551-c89a-4b4f-a026-5e23f39a1355", "name": "network-vif-deleted", "tag": "8a64e1a8-08fe-42cc-84de-a5e3362d89fc"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:18.808288 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-2512cfdc-7c52-4ae2-bdad-712c526dd1f9 req-e1f8532f-ce92-405f-b6ce-9a018c646e11 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:18.808872 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-2512cfdc-7c52-4ae2-bdad-712c526dd1f9 req-e1f8532f-ce92-405f-b6ce-9a018c646e11 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:18.809477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-2512cfdc-7c52-4ae2-bdad-712c526dd1f9 req-e1f8532f-ce92-405f-b6ce-9a018c646e11 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:18.820818 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-2512cfdc-7c52-4ae2-bdad-712c526dd1f9 req-e1f8532f-ce92-405f-b6ce-9a018c646e11 service nova] Creating event network-vif-deleted:8a64e1a8-08fe-42cc-84de-a5e3362d89fc for instance fe69a551-c89a-4b4f-a026-5e23f39a1355 on hv-cinder-74014 Sep 16 08:10:18.827052 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-2512cfdc-7c52-4ae2-bdad-712c526dd1f9 req-e1f8532f-ce92-405f-b6ce-9a018c646e11 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034526 Sep 16 08:10:18.827960 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 316/670] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:10:18 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:19.139003 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:19.139620 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:19.145956 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:19.146482 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:19.146958 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:19.147665 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:19.148120 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:19.148556 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:19.181356 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:19.181844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:19.182292 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:19.182769 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lazy-loading 'fault' on Instance uuid 998c37d2-18ab-459f-a9d6-bf19c51fb695 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:10:19.225186 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '66702831c1ca4158976920f6be2cc80c', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '5870af1bbad64b138178c47e4a571d81', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:19.233220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8e4bf9a3-4ebf-479b-8fde-ae5ddf46b798 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 200 len: 1348 microversion: 2.1 time: 0.098692 Sep 16 08:10:19.233887 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 355/671] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:19 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 1348 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:19.293376 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-72d294df-ba92-44e6-b9f1-de0d77bb92ab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:19.294074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-72d294df-ba92-44e6-b9f1-de0d77bb92ab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:19.301907 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72d294df-ba92-44e6-b9f1-de0d77bb92ab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:19.302391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72d294df-ba92-44e6-b9f1-de0d77bb92ab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:19.302860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72d294df-ba92-44e6-b9f1-de0d77bb92ab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:19.303552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72d294df-ba92-44e6-b9f1-de0d77bb92ab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:19.304030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72d294df-ba92-44e6-b9f1-de0d77bb92ab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:19.304459 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72d294df-ba92-44e6-b9f1-de0d77bb92ab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:19.370761 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-72d294df-ba92-44e6-b9f1-de0d77bb92ab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:19.380409 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-72d294df-ba92-44e6-b9f1-de0d77bb92ab tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 200 len: 1320 microversion: 2.1 time: 0.090592 Sep 16 08:10:19.381406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 317/672] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:19 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 1320 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:20.256786 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-85db85ff-82e7-4fdf-875d-ea924333d811 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:20.257423 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-85db85ff-82e7-4fdf-875d-ea924333d811 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [instance: 998c37d2-18ab-459f-a9d6-bf19c51fb695] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:20.264624 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-85db85ff-82e7-4fdf-875d-ea924333d811 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:20.265103 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-85db85ff-82e7-4fdf-875d-ea924333d811 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:20.265536 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-85db85ff-82e7-4fdf-875d-ea924333d811 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:20.266229 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-85db85ff-82e7-4fdf-875d-ea924333d811 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:20.266697 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-85db85ff-82e7-4fdf-875d-ea924333d811 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:20.267128 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-85db85ff-82e7-4fdf-875d-ea924333d811 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:20.281798 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-85db85ff-82e7-4fdf-875d-ea924333d811 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] HTTP exception thrown: Instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 could not be found. Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-85db85ff-82e7-4fdf-875d-ea924333d811 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Request method failure captured: Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 HTTP/1.1 Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC6bYdHwS--WA9o7PEqJXZRaGD-4Tj0yvvGUfZmH1meY1TsWXoVuxaMoKt3opCaYQ4EpseUKRkYRjqzvOtQ6h9qlI-sC1ZXyCuEdOYtHg_c1SIXTXc9wQz0VrM1oHmlVRdMSgmlYtocf0X8XwmUB3Qpq4TqlLnIxFnQoxB1kVQQ52Mw Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 5870af1bbad64b138178c47e4a571d81 Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-TestMinimumBasicScenario-31467956 Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:10:20.283453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:10:20.285049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5870af1bbad64b138178c47e4a571d81"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/5870af1bbad64b138178c47e4a571d81"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_5870af1bbad64b138178c47e4a571d81", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/5870af1bbad64b138178c47e4a571d81"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:10:20.285049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-TestMinimumBasicScenario-31467956 Sep 16 08:10:20.285049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 5870af1bbad64b138178c47e4a571d81 Sep 16 08:10:20.285049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-TestMinimumBasicScenario-31467956 Sep 16 08:10:20.285049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-TestMinimumBasicScenario-31467956-project Sep 16 08:10:20.285049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:10:20.285049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:10:20.285049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: 66702831c1ca4158976920f6be2cc80c Sep 16 08:10:20.285049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-TestMinimumBasicScenario-31467956-project Sep 16 08:10:20.285049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:10:20.285049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 could not be found. Sep 16 08:10:20.285049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '998c37d2-18ab-459f-a9d6-bf19c51fb695'} Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 could not be found. Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:10:20.296078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 could not be found. Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 could not be found. Sep 16 08:10:20.297543 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:20.299111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-85db85ff-82e7-4fdf-875d-ea924333d811 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Returning 404 to user: Instance 998c37d2-18ab-459f-a9d6-bf19c51fb695 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:10:20.299111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-85db85ff-82e7-4fdf-875d-ea924333d811 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695" status: 404 len: 111 microversion: 2.1 time: 0.032056 Sep 16 08:10:20.299111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 356/673] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:20 2022] GET /compute/v2.1/servers/998c37d2-18ab-459f-a9d6-bf19c51fb695 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:10:20.299363 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-70b64f01-32d5-4ed0-bbf7-1583ac4101c3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] Calling method '.version_select at 0x7f9d0684d280>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:20.299363 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR oslo.messaging._drivers.impl_rabbit [None req-70b64f01-32d5-4ed0-bbf7-1583ac4101c3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [d93d8d5f-f64d-43eb-9cc0-b103d3fc295d] AMQP server on 10.222.0.59:5672 is unreachable: [Errno 104] Connection reset by peer. Trying again in 1 seconds.: ConnectionResetError: [Errno 104] Connection reset by peer Sep 16 08:10:20.404159 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-683ab779-6424-4eb7-b1a6-ad356e29f1bc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:20.404781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-683ab779-6424-4eb7-b1a6-ad356e29f1bc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:20.410983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-683ab779-6424-4eb7-b1a6-ad356e29f1bc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:20.411477 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-683ab779-6424-4eb7-b1a6-ad356e29f1bc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:20.411942 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-683ab779-6424-4eb7-b1a6-ad356e29f1bc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:20.412638 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-683ab779-6424-4eb7-b1a6-ad356e29f1bc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:20.413095 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-683ab779-6424-4eb7-b1a6-ad356e29f1bc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:20.413528 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-683ab779-6424-4eb7-b1a6-ad356e29f1bc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:20.426697 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-683ab779-6424-4eb7-b1a6-ad356e29f1bc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] HTTP exception thrown: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-683ab779-6424-4eb7-b1a6-ad356e29f1bc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Request method failure captured: Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 HTTP/1.1 Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5Hk4j_hjkfTYRalbAq7nKYw4un_VSdFpY9pPls5xpTZuPtwEbByuSCvNtEc66xwWeTjpgYOCh4UqNanlMOuJNnx-H_Lb5jOcR4Gk7-HtkwYrbz5YXG6rBjO6fKEjnfhzS6G30okaMCloyyOID1PArRtHdiRbl2kj-ouy60IMAUU74 Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 45838a0f741e485e8f424375c6d0d489 Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:10:20.436489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:10:20.438106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_45838a0f741e485e8f424375c6d0d489", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:10:20.438106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:10:20.438106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 45838a0f741e485e8f424375c6d0d489 Sep 16 08:10:20.438106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:10:20.438106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-AttachVolumeTestJSON-1548693197-project Sep 16 08:10:20.438106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:10:20.438106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:10:20.438106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: 393fddf9c75447fab334b84694dcf4f1 Sep 16 08:10:20.438106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-AttachVolumeTestJSON-1548693197-project Sep 16 08:10:20.438106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:10:20.438106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:10:20.438106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': 'fe69a551-c89a-4b4f-a026-5e23f39a1355'} Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:10:20.439117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:10:20.440560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:20.441844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-683ab779-6424-4eb7-b1a6-ad356e29f1bc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Returning 404 to user: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:10:20.441844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-683ab779-6424-4eb7-b1a6-ad356e29f1bc tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 404 len: 111 microversion: 2.1 time: 0.030387 Sep 16 08:10:20.441844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 357/674] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:20 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 08:10:20.441844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5bfe80d1-f70c-47ed-b35e-0c0a19152752 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '.version_select at 0x7f9d06b40310>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:20.565962 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5bfe80d1-f70c-47ed-b35e-0c0a19152752 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-81381970" status: 202 len: 0 microversion: 2.1 time: 0.131163 Sep 16 08:10:20.566458 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 358/675] 10.222.0.59 () {58 vars in 1215 bytes} [Fri Sep 16 08:10:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-81381970 => generated 0 bytes in 132 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 08:10:21.307924 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO oslo.messaging._drivers.impl_rabbit [None req-70b64f01-32d5-4ed0-bbf7-1583ac4101c3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] [d93d8d5f-f64d-43eb-9cc0-b103d3fc295d] Reconnected to AMQP server on 10.222.0.59:5672 via [amqp] client with port 42152. Sep 16 08:10:21.308473 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-92a7b1e3-9421-40da-9cc2-61a6e027f7d5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Action: 'create', calling method: .version_select at 0x7f9d06bb2040>, body: {"keypair": {"name": "tempest-keypair-1160767336", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJrXZ2PWHCFDNKgx4kfwkOc0FGPoSoSB1O8X0JykALW9370l9m8Fvdn+Zm0m/R9OtMRCh4rNoTiTVSUE4jHrilw1OVrxLgu6UtDVLRToEeTqQxjwfby3Zt5RNWKRoV19mw=="}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:21.326343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-92a7b1e3-9421-40da-9cc2-61a6e027f7d5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Getting quotas for project 45838a0f741e485e8f424375c6d0d489. Resources: {'key_pairs'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:10:21.330211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-92a7b1e3-9421-40da-9cc2-61a6e027f7d5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Getting quotas for user 393fddf9c75447fab334b84694dcf4f1 and project 45838a0f741e485e8f424375c6d0d489. Resources: {'key_pairs'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:10:21.385259 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-70b64f01-32d5-4ed0-bbf7-1583ac4101c3 tempest-TestMinimumBasicScenario-31467956 tempest-TestMinimumBasicScenario-31467956-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-577618645" status: 202 len: 0 microversion: 2.1 time: 1.095218 Sep 16 08:10:21.385847 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 318/676] 10.222.0.59 () {58 vars in 1269 bytes} [Fri Sep 16 08:10:20 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestMinimumBasicScenario-577618645 => generated 0 bytes in 1097 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:10:21.414150 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-92a7b1e3-9421-40da-9cc2-61a6e027f7d5 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 386 microversion: 2.1 time: 0.110212 Sep 16 08:10:21.414941 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 359/677] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Sep 16 08:10:21 2022] POST /compute/v2.1/os-keypairs => generated 386 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:10:24.346914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeTestJSON-server-1118287871", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "f6b86e2a-3872-426c-a67d-323df7f17364"}], "security_groups": [{"name": "tempest-securitygroup--1774547486"}], "key_name": "tempest-keypair-1160767336", "user_data": "}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:24.826503 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.network.neutron [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] validate_networks() for [('f6b86e2a-3872-426c-a67d-323df7f17364', None, None, None, None, None)] {{(pid=121047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:10:25.459694 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Flavor limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:10:25.460317 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Image limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:10:25.460591 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Flavor pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:10:25.460998 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Image pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:10:25.461404 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:10:25.470023 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:25.470498 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:25.470959 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:25.471674 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:25.472123 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:25.472545 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:25.488603 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Getting quotas for project 45838a0f741e485e8f424375c6d0d489. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:10:25.492483 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Getting quotas for user 393fddf9c75447fab334b84694dcf4f1 and project 45838a0f741e485e8f424375c6d0d489. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:10:25.503829 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Going to run 1 instances... {{(pid=121047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:10:25.506121 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:10:25.646779 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-397f19c0-233e-42d9-b629-dd3bdf5ea721 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 402 microversion: 2.1 time: 1.304937 Sep 16 08:10:25.648468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 319/678] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:10:24 2022] POST /compute/v2.1/servers => generated 402 bytes in 1307 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:10:25.667641 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-33c2fb19-5fe4-4810-9424-737f70543be4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:25.669057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-33c2fb19-5fe4-4810-9424-737f70543be4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:25.731149 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-33c2fb19-5fe4-4810-9424-737f70543be4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:25.738928 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-33c2fb19-5fe4-4810-9424-737f70543be4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1238 microversion: 2.1 time: 0.075782 Sep 16 08:10:25.740808 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 360/679] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:25 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1238 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:26.762128 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a19394ee-02a8-4c49-a317-9d4d7395f39c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:26.762802 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a19394ee-02a8-4c49-a317-9d4d7395f39c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:26.769692 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a19394ee-02a8-4c49-a317-9d4d7395f39c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:26.770224 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a19394ee-02a8-4c49-a317-9d4d7395f39c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:26.770709 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a19394ee-02a8-4c49-a317-9d4d7395f39c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:26.771480 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a19394ee-02a8-4c49-a317-9d4d7395f39c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:26.771944 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a19394ee-02a8-4c49-a317-9d4d7395f39c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:26.772380 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a19394ee-02a8-4c49-a317-9d4d7395f39c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:26.836034 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a19394ee-02a8-4c49-a317-9d4d7395f39c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:26.845540 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a19394ee-02a8-4c49-a317-9d4d7395f39c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1242 microversion: 2.1 time: 0.087945 Sep 16 08:10:26.846122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 320/680] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:26 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1242 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:27.869375 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-487d2755-2158-412d-b1c8-b49db05074ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:27.869973 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-487d2755-2158-412d-b1c8-b49db05074ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:27.876536 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-487d2755-2158-412d-b1c8-b49db05074ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:27.877111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-487d2755-2158-412d-b1c8-b49db05074ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:27.877632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-487d2755-2158-412d-b1c8-b49db05074ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:27.878402 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-487d2755-2158-412d-b1c8-b49db05074ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:27.878995 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-487d2755-2158-412d-b1c8-b49db05074ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:27.879870 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-487d2755-2158-412d-b1c8-b49db05074ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:27.959109 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-487d2755-2158-412d-b1c8-b49db05074ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:27.967350 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-487d2755-2158-412d-b1c8-b49db05074ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1290 microversion: 2.1 time: 0.102198 Sep 16 08:10:27.967927 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 361/681] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:27 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1290 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:28.990900 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ff12906a-2164-4ac2-bf4c-29d7a20c584a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:28.991728 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ff12906a-2164-4ac2-bf4c-29d7a20c584a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:28.998283 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ff12906a-2164-4ac2-bf4c-29d7a20c584a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:28.998888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ff12906a-2164-4ac2-bf4c-29d7a20c584a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:28.999413 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ff12906a-2164-4ac2-bf4c-29d7a20c584a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:29.000189 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ff12906a-2164-4ac2-bf4c-29d7a20c584a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:29.000700 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ff12906a-2164-4ac2-bf4c-29d7a20c584a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:29.001195 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ff12906a-2164-4ac2-bf4c-29d7a20c584a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:29.498515 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ff12906a-2164-4ac2-bf4c-29d7a20c584a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:29.507421 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ff12906a-2164-4ac2-bf4c-29d7a20c584a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1364 microversion: 2.1 time: 0.520573 Sep 16 08:10:29.508000 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 321/682] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:28 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1364 bytes in 522 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:30.393492 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-b162960d-e526-44a4-80bb-a29029817246 req-5aff0bcc-dac9-4ac4-9413-353975392f04 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "172d6ac8-f22f-4167-b9c2-4da9eef51e88", "tag": "ed18c377-ec53-4436-81b8-4ffcc88a10c0"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:30.400174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=77,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:30.406493 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b162960d-e526-44a4-80bb-a29029817246 req-5aff0bcc-dac9-4ac4-9413-353975392f04 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:30.407020 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b162960d-e526-44a4-80bb-a29029817246 req-5aff0bcc-dac9-4ac4-9413-353975392f04 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:30.407631 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b162960d-e526-44a4-80bb-a29029817246 req-5aff0bcc-dac9-4ac4-9413-353975392f04 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:30.411585 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:30.419165 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-b162960d-e526-44a4-80bb-a29029817246 req-5aff0bcc-dac9-4ac4-9413-353975392f04 service nova] Creating event network-changed:ed18c377-ec53-4436-81b8-4ffcc88a10c0 for instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 on hv-cinder-74014 Sep 16 08:10:30.425931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-b162960d-e526-44a4-80bb-a29029817246 req-5aff0bcc-dac9-4ac4-9413-353975392f04 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035921 Sep 16 08:10:30.426877 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 362/683] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:10:30 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 38 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:30.531688 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-54fc0487-ec6b-4112-b98c-d3c26f942d25 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:30.532307 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-54fc0487-ec6b-4112-b98c-d3c26f942d25 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:30.539208 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-54fc0487-ec6b-4112-b98c-d3c26f942d25 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:30.539708 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-54fc0487-ec6b-4112-b98c-d3c26f942d25 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:30.540149 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-54fc0487-ec6b-4112-b98c-d3c26f942d25 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:30.540905 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-54fc0487-ec6b-4112-b98c-d3c26f942d25 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:30.541361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-54fc0487-ec6b-4112-b98c-d3c26f942d25 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:30.541852 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-54fc0487-ec6b-4112-b98c-d3c26f942d25 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:30.891253 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-54fc0487-ec6b-4112-b98c-d3c26f942d25 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:30.899649 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-54fc0487-ec6b-4112-b98c-d3c26f942d25 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1364 microversion: 2.1 time: 0.372140 Sep 16 08:10:30.900451 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 322/684] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:30 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1364 bytes in 374 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:31.923380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cf0e83f1-8063-459c-b892-eb19ffc1bc37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:31.924092 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cf0e83f1-8063-459c-b892-eb19ffc1bc37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:31.931704 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf0e83f1-8063-459c-b892-eb19ffc1bc37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:31.932196 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf0e83f1-8063-459c-b892-eb19ffc1bc37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:31.932639 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf0e83f1-8063-459c-b892-eb19ffc1bc37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:31.933837 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf0e83f1-8063-459c-b892-eb19ffc1bc37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:31.934315 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf0e83f1-8063-459c-b892-eb19ffc1bc37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:31.934787 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf0e83f1-8063-459c-b892-eb19ffc1bc37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:32.071174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cf0e83f1-8063-459c-b892-eb19ffc1bc37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:32.079548 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cf0e83f1-8063-459c-b892-eb19ffc1bc37 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1364 microversion: 2.1 time: 0.161045 Sep 16 08:10:32.080108 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 363/685] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:31 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:33.101929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-47fecfab-5b71-46b2-9411-2346cccbdf4c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:33.102454 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-47fecfab-5b71-46b2-9411-2346cccbdf4c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:33.108901 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-47fecfab-5b71-46b2-9411-2346cccbdf4c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:33.109704 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-47fecfab-5b71-46b2-9411-2346cccbdf4c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:33.110153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-47fecfab-5b71-46b2-9411-2346cccbdf4c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:33.110873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-47fecfab-5b71-46b2-9411-2346cccbdf4c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:33.111326 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-47fecfab-5b71-46b2-9411-2346cccbdf4c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:33.111750 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-47fecfab-5b71-46b2-9411-2346cccbdf4c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:33.249891 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-47fecfab-5b71-46b2-9411-2346cccbdf4c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:33.259045 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-47fecfab-5b71-46b2-9411-2346cccbdf4c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1364 microversion: 2.1 time: 0.160996 Sep 16 08:10:33.272631 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 323/686] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:33 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1364 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:34.283348 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6d8e782d-2346-4510-b798-a27ce7d62ccd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:34.283950 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6d8e782d-2346-4510-b798-a27ce7d62ccd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:34.291144 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d8e782d-2346-4510-b798-a27ce7d62ccd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:34.291630 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d8e782d-2346-4510-b798-a27ce7d62ccd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:34.292068 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d8e782d-2346-4510-b798-a27ce7d62ccd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:34.293389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d8e782d-2346-4510-b798-a27ce7d62ccd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:34.293845 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d8e782d-2346-4510-b798-a27ce7d62ccd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:34.294275 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6d8e782d-2346-4510-b798-a27ce7d62ccd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:34.419763 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6d8e782d-2346-4510-b798-a27ce7d62ccd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:34.427360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6d8e782d-2346-4510-b798-a27ce7d62ccd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1364 microversion: 2.1 time: 0.148469 Sep 16 08:10:34.427921 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 364/687] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:34 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1364 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:35.449797 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f2147e95-e09b-4bb5-b2e7-daf3bf664e40 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:35.450858 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f2147e95-e09b-4bb5-b2e7-daf3bf664e40 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:35.457597 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2147e95-e09b-4bb5-b2e7-daf3bf664e40 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:35.458091 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2147e95-e09b-4bb5-b2e7-daf3bf664e40 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:35.459733 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2147e95-e09b-4bb5-b2e7-daf3bf664e40 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:35.459733 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2147e95-e09b-4bb5-b2e7-daf3bf664e40 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:35.459733 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2147e95-e09b-4bb5-b2e7-daf3bf664e40 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:35.460148 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2147e95-e09b-4bb5-b2e7-daf3bf664e40 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:35.481777 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:35.500073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=6 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:35.590994 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f2147e95-e09b-4bb5-b2e7-daf3bf664e40 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:35.599412 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f2147e95-e09b-4bb5-b2e7-daf3bf664e40 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1364 microversion: 2.1 time: 0.153941 Sep 16 08:10:35.599982 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 324/688] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:35 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1364 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:36.621316 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e8788f38-1ddf-4f85-a522-eb6aebbf15fb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:36.621856 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e8788f38-1ddf-4f85-a522-eb6aebbf15fb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:36.624302 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=6 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:36.629118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e8788f38-1ddf-4f85-a522-eb6aebbf15fb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:36.629604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e8788f38-1ddf-4f85-a522-eb6aebbf15fb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:36.630047 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e8788f38-1ddf-4f85-a522-eb6aebbf15fb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:36.630766 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e8788f38-1ddf-4f85-a522-eb6aebbf15fb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:36.631226 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e8788f38-1ddf-4f85-a522-eb6aebbf15fb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:36.636246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e8788f38-1ddf-4f85-a522-eb6aebbf15fb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:36.764334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e8788f38-1ddf-4f85-a522-eb6aebbf15fb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:36.771915 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e8788f38-1ddf-4f85-a522-eb6aebbf15fb tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1364 microversion: 2.1 time: 0.154506 Sep 16 08:10:36.772488 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 365/689] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:36 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1364 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:37.497873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-0b56b699-52e9-4a49-920d-f27edeaabf82 req-9b7cb4ab-95ed-4819-9e45-6cedf50dbcab service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "172d6ac8-f22f-4167-b9c2-4da9eef51e88", "name": "network-vif-plugged", "status": "completed", "tag": "ed18c377-ec53-4436-81b8-4ffcc88a10c0"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:37.507904 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-0b56b699-52e9-4a49-920d-f27edeaabf82 req-9b7cb4ab-95ed-4819-9e45-6cedf50dbcab service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:37.508384 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-0b56b699-52e9-4a49-920d-f27edeaabf82 req-9b7cb4ab-95ed-4819-9e45-6cedf50dbcab service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:37.511888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-0b56b699-52e9-4a49-920d-f27edeaabf82 req-9b7cb4ab-95ed-4819-9e45-6cedf50dbcab service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:37.520104 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-0b56b699-52e9-4a49-920d-f27edeaabf82 req-9b7cb4ab-95ed-4819-9e45-6cedf50dbcab service nova] Creating event network-vif-plugged:ed18c377-ec53-4436-81b8-4ffcc88a10c0 for instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 on hv-cinder-74014 Sep 16 08:10:37.525098 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-0b56b699-52e9-4a49-920d-f27edeaabf82 req-9b7cb4ab-95ed-4819-9e45-6cedf50dbcab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031518 Sep 16 08:10:37.525674 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 325/690] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:10:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:37.796493 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-45928821-3e9e-4a54-968e-18c431cf252d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:37.797099 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-45928821-3e9e-4a54-968e-18c431cf252d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:37.803450 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45928821-3e9e-4a54-968e-18c431cf252d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:37.803932 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45928821-3e9e-4a54-968e-18c431cf252d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:37.804434 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45928821-3e9e-4a54-968e-18c431cf252d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:37.805151 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45928821-3e9e-4a54-968e-18c431cf252d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:37.805601 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45928821-3e9e-4a54-968e-18c431cf252d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:37.806023 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45928821-3e9e-4a54-968e-18c431cf252d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:37.943341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-45928821-3e9e-4a54-968e-18c431cf252d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:37.951129 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-45928821-3e9e-4a54-968e-18c431cf252d tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1364 microversion: 2.1 time: 0.159057 Sep 16 08:10:37.951734 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 366/691] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:37 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1364 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:38.975854 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b178435c-15bc-4ded-92a6-f15292f1f036 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:38.976556 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b178435c-15bc-4ded-92a6-f15292f1f036 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:38.982639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b178435c-15bc-4ded-92a6-f15292f1f036 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:38.983153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b178435c-15bc-4ded-92a6-f15292f1f036 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:38.983595 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b178435c-15bc-4ded-92a6-f15292f1f036 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:38.984290 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b178435c-15bc-4ded-92a6-f15292f1f036 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:38.984747 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b178435c-15bc-4ded-92a6-f15292f1f036 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:38.985173 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b178435c-15bc-4ded-92a6-f15292f1f036 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:39.113260 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b178435c-15bc-4ded-92a6-f15292f1f036 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:39.121564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b178435c-15bc-4ded-92a6-f15292f1f036 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1364 microversion: 2.1 time: 0.150569 Sep 16 08:10:39.122128 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 326/692] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:38 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1364 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:40.144272 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-686bdae9-3cd8-456c-a7c6-f37d5f1b75ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:40.144811 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-686bdae9-3cd8-456c-a7c6-f37d5f1b75ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:40.151075 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-686bdae9-3cd8-456c-a7c6-f37d5f1b75ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:40.151567 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-686bdae9-3cd8-456c-a7c6-f37d5f1b75ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:40.152008 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-686bdae9-3cd8-456c-a7c6-f37d5f1b75ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:40.152700 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-686bdae9-3cd8-456c-a7c6-f37d5f1b75ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:40.153162 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-686bdae9-3cd8-456c-a7c6-f37d5f1b75ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:40.153592 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-686bdae9-3cd8-456c-a7c6-f37d5f1b75ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:40.278791 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-686bdae9-3cd8-456c-a7c6-f37d5f1b75ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:40.286735 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-686bdae9-3cd8-456c-a7c6-f37d5f1b75ec tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1551 microversion: 2.1 time: 0.146379 Sep 16 08:10:40.291730 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 367/693] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:40 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1551 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:40.309321 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d82bd455-7e5b-47b3-b63d-82794a8eb987 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:40.309824 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d82bd455-7e5b-47b3-b63d-82794a8eb987 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:40.312204 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=63,nova_api:UPDATE=1,nova_api:DELETE=1,nova_api:INSERT=3 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:40.316796 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d82bd455-7e5b-47b3-b63d-82794a8eb987 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:40.317273 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d82bd455-7e5b-47b3-b63d-82794a8eb987 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:40.320374 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d82bd455-7e5b-47b3-b63d-82794a8eb987 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:40.320374 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d82bd455-7e5b-47b3-b63d-82794a8eb987 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:40.320374 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d82bd455-7e5b-47b3-b63d-82794a8eb987 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:40.320374 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d82bd455-7e5b-47b3-b63d-82794a8eb987 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:40.397531 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d82bd455-7e5b-47b3-b63d-82794a8eb987 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-interface" status: 200 len: 285 microversion: 2.1 time: 0.092559 Sep 16 08:10:40.398129 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 327/694] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Sep 16 08:10:40 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-interface => generated 285 bytes in 94 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:10:41.347438 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-37e6f941-ac89-44b6-bbbc-ad88e3c22521 req-e97081bc-0b09-4d4a-b6b6-2661a1d5edbe service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "172d6ac8-f22f-4167-b9c2-4da9eef51e88", "tag": "ed18c377-ec53-4436-81b8-4ffcc88a10c0"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:41.357090 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-37e6f941-ac89-44b6-bbbc-ad88e3c22521 req-e97081bc-0b09-4d4a-b6b6-2661a1d5edbe service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:41.357568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-37e6f941-ac89-44b6-bbbc-ad88e3c22521 req-e97081bc-0b09-4d4a-b6b6-2661a1d5edbe service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:41.357997 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-37e6f941-ac89-44b6-bbbc-ad88e3c22521 req-e97081bc-0b09-4d4a-b6b6-2661a1d5edbe service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:41.369017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-37e6f941-ac89-44b6-bbbc-ad88e3c22521 req-e97081bc-0b09-4d4a-b6b6-2661a1d5edbe service nova] Creating event network-changed:ed18c377-ec53-4436-81b8-4ffcc88a10c0 for instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 on hv-cinder-74014 Sep 16 08:10:41.374436 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-37e6f941-ac89-44b6-bbbc-ad88e3c22521 req-e97081bc-0b09-4d4a-b6b6-2661a1d5edbe service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030248 Sep 16 08:10:41.375180 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 368/695] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:10:41 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:10:43.596816 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-80e4c587-eeb6-4b7f-9161-faeb35ec9360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:43.597297 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-80e4c587-eeb6-4b7f-9161-faeb35ec9360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:43.603400 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80e4c587-eeb6-4b7f-9161-faeb35ec9360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:43.603885 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80e4c587-eeb6-4b7f-9161-faeb35ec9360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:43.604326 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80e4c587-eeb6-4b7f-9161-faeb35ec9360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:43.605540 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80e4c587-eeb6-4b7f-9161-faeb35ec9360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:43.606000 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80e4c587-eeb6-4b7f-9161-faeb35ec9360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:43.606430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-80e4c587-eeb6-4b7f-9161-faeb35ec9360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:43.635026 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-80e4c587-eeb6-4b7f-9161-faeb35ec9360 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-volume_attachments/7aba4e65-c67a-45e1-af7c-4a3569a2817b" status: 200 len: 194 microversion: 2.20 time: 0.042895 Sep 16 08:10:43.635597 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 328/696] 10.222.0.59 () {60 vars in 1454 bytes} [Fri Sep 16 08:10:43 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-volume_attachments/7aba4e65-c67a-45e1-af7c-4a3569a2817b => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 08:10:43.704730 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ff8e3a8f-1a93-423e-b434-dd4301ec5efe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:43.705331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ff8e3a8f-1a93-423e-b434-dd4301ec5efe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:43.711866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff8e3a8f-1a93-423e-b434-dd4301ec5efe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:43.713694 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff8e3a8f-1a93-423e-b434-dd4301ec5efe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:43.713694 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff8e3a8f-1a93-423e-b434-dd4301ec5efe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:43.713694 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff8e3a8f-1a93-423e-b434-dd4301ec5efe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:43.713936 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff8e3a8f-1a93-423e-b434-dd4301ec5efe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:43.714322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff8e3a8f-1a93-423e-b434-dd4301ec5efe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:43.796138 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-ff8e3a8f-1a93-423e-b434-dd4301ec5efe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lazy-loading 'services' on Instance uuid 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:10:44.050186 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ff8e3a8f-1a93-423e-b434-dd4301ec5efe tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-volume_attachments/7aba4e65-c67a-45e1-af7c-4a3569a2817b" status: 202 len: 0 microversion: 2.20 time: 0.349576 Sep 16 08:10:44.050796 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 369/697] 10.222.0.59 () {60 vars in 1457 bytes} [Fri Sep 16 08:10:43 2022] DELETE /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-volume_attachments/7aba4e65-c67a-45e1-af7c-4a3569a2817b => generated 0 bytes in 351 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:10:44.059283 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3f0582ab-43f0-4668-af49-5f61ce8fabba tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:44.061505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3f0582ab-43f0-4668-af49-5f61ce8fabba tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:44.067484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3f0582ab-43f0-4668-af49-5f61ce8fabba tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:44.067967 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3f0582ab-43f0-4668-af49-5f61ce8fabba tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:44.068405 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3f0582ab-43f0-4668-af49-5f61ce8fabba tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:44.069098 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3f0582ab-43f0-4668-af49-5f61ce8fabba tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:44.069555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3f0582ab-43f0-4668-af49-5f61ce8fabba tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:44.069983 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3f0582ab-43f0-4668-af49-5f61ce8fabba tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:44.102120 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3f0582ab-43f0-4668-af49-5f61ce8fabba tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.046870 Sep 16 08:10:44.102693 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 329/698] 10.222.0.59 () {60 vars in 1343 bytes} [Fri Sep 16 08:10:44 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 359 bytes (2 switches on core 0) Sep 16 08:10:44.306522 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-29c641c4-de73-424e-b310-bd780eeaf8c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:44.307149 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-29c641c4-de73-424e-b310-bd780eeaf8c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:44.313359 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-29c641c4-de73-424e-b310-bd780eeaf8c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:44.313849 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-29c641c4-de73-424e-b310-bd780eeaf8c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:44.314288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-29c641c4-de73-424e-b310-bd780eeaf8c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:44.315008 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-29c641c4-de73-424e-b310-bd780eeaf8c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:44.315470 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-29c641c4-de73-424e-b310-bd780eeaf8c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:44.315898 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-29c641c4-de73-424e-b310-bd780eeaf8c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:44.339066 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-29c641c4-de73-424e-b310-bd780eeaf8c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/ips" status: 200 len: 150 microversion: 2.1 time: 0.200443 Sep 16 08:10:44.340212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 370/699] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Sep 16 08:10:44 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/ips => generated 150 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:45.115667 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-96a078b4-8539-4669-a1b3-e0aefb9cb5fd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:45.117816 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-96a078b4-8539-4669-a1b3-e0aefb9cb5fd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:45.124424 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-96a078b4-8539-4669-a1b3-e0aefb9cb5fd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:45.124908 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-96a078b4-8539-4669-a1b3-e0aefb9cb5fd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:45.125432 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-96a078b4-8539-4669-a1b3-e0aefb9cb5fd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:45.126127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-96a078b4-8539-4669-a1b3-e0aefb9cb5fd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:45.126585 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-96a078b4-8539-4669-a1b3-e0aefb9cb5fd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:45.127046 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-96a078b4-8539-4669-a1b3-e0aefb9cb5fd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:45.130700 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=92,nova_cell1:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:45.157404 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-96a078b4-8539-4669-a1b3-e0aefb9cb5fd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-volume_attachments" status: 200 len: 197 microversion: 2.20 time: 0.045676 Sep 16 08:10:45.157957 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 330/700] 10.222.0.59 () {60 vars in 1343 bytes} [Fri Sep 16 08:10:45 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 08:10:45.581732 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ca7d8b4c-592a-4615-84ff-da1297420d8a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:45.582265 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ca7d8b4c-592a-4615-84ff-da1297420d8a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:45.588677 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ca7d8b4c-592a-4615-84ff-da1297420d8a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:45.589191 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ca7d8b4c-592a-4615-84ff-da1297420d8a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:45.589627 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ca7d8b4c-592a-4615-84ff-da1297420d8a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:45.590312 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ca7d8b4c-592a-4615-84ff-da1297420d8a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:45.590796 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ca7d8b4c-592a-4615-84ff-da1297420d8a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:45.591220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ca7d8b4c-592a-4615-84ff-da1297420d8a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:45.672285 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-ca7d8b4c-592a-4615-84ff-da1297420d8a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lazy-loading 'services' on Instance uuid 5e79005e-be5d-4326-aa8d-28bdef7f1a3b {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:10:45.891538 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ca7d8b4c-592a-4615-84ff-da1297420d8a tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments/b6cc13a8-8428-4403-ae39-f49efdfcbcf3" status: 202 len: 0 microversion: 2.1 time: 0.313438 Sep 16 08:10:45.892059 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 371/701] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Sep 16 08:10:45 2022] DELETE /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments/b6cc13a8-8428-4403-ae39-f49efdfcbcf3 => generated 0 bytes in 315 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:10:45.901059 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-75fbad2a-c1b3-4ba5-8fc6-e08a50ee7175 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:45.903264 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-75fbad2a-c1b3-4ba5-8fc6-e08a50ee7175 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:45.910117 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-75fbad2a-c1b3-4ba5-8fc6-e08a50ee7175 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:45.910606 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-75fbad2a-c1b3-4ba5-8fc6-e08a50ee7175 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:45.911071 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-75fbad2a-c1b3-4ba5-8fc6-e08a50ee7175 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:45.911797 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-75fbad2a-c1b3-4ba5-8fc6-e08a50ee7175 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:45.912249 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-75fbad2a-c1b3-4ba5-8fc6-e08a50ee7175 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:45.912676 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-75fbad2a-c1b3-4ba5-8fc6-e08a50ee7175 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:45.943727 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-75fbad2a-c1b3-4ba5-8fc6-e08a50ee7175 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046991 Sep 16 08:10:45.944301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 331/702] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:10:45 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:45.973752 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f8141f1c-8aea-481c-bd03-c8aaa45a25c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92a8939f-1da0-4f5a-a77a-fd4b1e91734d"}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:45.976389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f8141f1c-8aea-481c-bd03-c8aaa45a25c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:45.983073 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f8141f1c-8aea-481c-bd03-c8aaa45a25c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:45.983553 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f8141f1c-8aea-481c-bd03-c8aaa45a25c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:45.983986 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f8141f1c-8aea-481c-bd03-c8aaa45a25c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:45.984669 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f8141f1c-8aea-481c-bd03-c8aaa45a25c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:45.985123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f8141f1c-8aea-481c-bd03-c8aaa45a25c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:45.985546 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f8141f1c-8aea-481c-bd03-c8aaa45a25c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:46.291774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0a08564f-4f8e-4885-85c4-30d847e510e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:46.291774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0a08564f-4f8e-4885-85c4-30d847e510e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:46.291774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0a08564f-4f8e-4885-85c4-30d847e510e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:46.291774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0a08564f-4f8e-4885-85c4-30d847e510e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:46.293964 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0a08564f-4f8e-4885-85c4-30d847e510e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:46.293964 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0a08564f-4f8e-4885-85c4-30d847e510e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:46.293964 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0a08564f-4f8e-4885-85c4-30d847e510e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:46.293964 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0a08564f-4f8e-4885-85c4-30d847e510e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:46.294428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0a08564f-4f8e-4885-85c4-30d847e510e0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.043942 Sep 16 08:10:46.294428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 332/703] 10.222.0.59 () {60 vars in 1343 bytes} [Fri Sep 16 08:10:46 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:10:46.355674 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2f41e261-9d0c-48fe-a6ae-e74aff4df499 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:46.356745 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2f41e261-9d0c-48fe-a6ae-e74aff4df499 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:46.362653 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2f41e261-9d0c-48fe-a6ae-e74aff4df499 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:46.363159 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2f41e261-9d0c-48fe-a6ae-e74aff4df499 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:46.363669 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2f41e261-9d0c-48fe-a6ae-e74aff4df499 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:46.364362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2f41e261-9d0c-48fe-a6ae-e74aff4df499 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:46.364821 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2f41e261-9d0c-48fe-a6ae-e74aff4df499 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:46.365245 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2f41e261-9d0c-48fe-a6ae-e74aff4df499 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:46.389542 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2f41e261-9d0c-48fe-a6ae-e74aff4df499 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Going to try to terminate instance {{(pid=121047) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:10:46.663169 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2f41e261-9d0c-48fe-a6ae-e74aff4df499 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 204 len: 0 microversion: 2.20 time: 0.311074 Sep 16 08:10:46.663885 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 333/704] 10.222.0.59 () {60 vars in 1280 bytes} [Fri Sep 16 08:10:46 2022] DELETE /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 0 bytes in 313 msecs (HTTP/1.1 204) 9 headers in 365 bytes (2 switches on core 0) Sep 16 08:10:46.673224 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f511a005-2f2e-4c69-9466-50646f9f5b7f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:46.673928 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f511a005-2f2e-4c69-9466-50646f9f5b7f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:46.683478 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f511a005-2f2e-4c69-9466-50646f9f5b7f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:46.683478 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f511a005-2f2e-4c69-9466-50646f9f5b7f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:46.683478 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f511a005-2f2e-4c69-9466-50646f9f5b7f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:46.683478 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f511a005-2f2e-4c69-9466-50646f9f5b7f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:46.683913 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f511a005-2f2e-4c69-9466-50646f9f5b7f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:46.683913 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f511a005-2f2e-4c69-9466-50646f9f5b7f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:46.821171 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f511a005-2f2e-4c69-9466-50646f9f5b7f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:46.829848 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f511a005-2f2e-4c69-9466-50646f9f5b7f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:46.831326 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f511a005-2f2e-4c69-9466-50646f9f5b7f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:46.832489 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f511a005-2f2e-4c69-9466-50646f9f5b7f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.163846 Sep 16 08:10:46.833047 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 334/705] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:46 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:10:46.956641 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e108b22e-e71c-479d-a885-7a4ee1aed5da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:46.958958 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e108b22e-e71c-479d-a885-7a4ee1aed5da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:46.964860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e108b22e-e71c-479d-a885-7a4ee1aed5da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:46.967984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e108b22e-e71c-479d-a885-7a4ee1aed5da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:46.967984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e108b22e-e71c-479d-a885-7a4ee1aed5da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:46.967984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e108b22e-e71c-479d-a885-7a4ee1aed5da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:46.967984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e108b22e-e71c-479d-a885-7a4ee1aed5da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:46.968386 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e108b22e-e71c-479d-a885-7a4ee1aed5da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:46.996694 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e108b22e-e71c-479d-a885-7a4ee1aed5da tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044285 Sep 16 08:10:46.997305 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 335/706] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:10:46 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:10:47.083871 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f8141f1c-8aea-481c-bd03-c8aaa45a25c1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 1.114357 Sep 16 08:10:47.084478 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 372/707] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:10:45 2022] POST /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments => generated 194 bytes in 1116 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:47.858716 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-35c1e8f1-8b95-49bd-9768-fd5f5f1f265a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:47.859335 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-35c1e8f1-8b95-49bd-9768-fd5f5f1f265a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:47.865830 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-35c1e8f1-8b95-49bd-9768-fd5f5f1f265a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:47.866318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-35c1e8f1-8b95-49bd-9768-fd5f5f1f265a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:47.866791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-35c1e8f1-8b95-49bd-9768-fd5f5f1f265a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:47.867497 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-35c1e8f1-8b95-49bd-9768-fd5f5f1f265a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:47.867950 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-35c1e8f1-8b95-49bd-9768-fd5f5f1f265a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:47.868378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-35c1e8f1-8b95-49bd-9768-fd5f5f1f265a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:47.995224 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-35c1e8f1-8b95-49bd-9768-fd5f5f1f265a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:48.003358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-35c1e8f1-8b95-49bd-9768-fd5f5f1f265a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:48.004980 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-35c1e8f1-8b95-49bd-9768-fd5f5f1f265a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:48.006152 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-35c1e8f1-8b95-49bd-9768-fd5f5f1f265a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.152045 Sep 16 08:10:48.006727 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 336/708] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:47 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:10:48.010871 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-61438c1a-c0ea-4227-ac8d-23e07096e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:48.013738 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-61438c1a-c0ea-4227-ac8d-23e07096e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:48.020023 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-61438c1a-c0ea-4227-ac8d-23e07096e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:48.020515 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-61438c1a-c0ea-4227-ac8d-23e07096e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:48.020965 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-61438c1a-c0ea-4227-ac8d-23e07096e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:48.021712 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-61438c1a-c0ea-4227-ac8d-23e07096e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:48.022215 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-61438c1a-c0ea-4227-ac8d-23e07096e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:48.022657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-61438c1a-c0ea-4227-ac8d-23e07096e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:48.052174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-61438c1a-c0ea-4227-ac8d-23e07096e6c0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.046269 Sep 16 08:10:48.052733 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 373/709] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:10:48 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments => generated 197 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:10:49.032010 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-cfec9578-4556-4d2d-a316-6e51280891b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:49.032574 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-cfec9578-4556-4d2d-a316-6e51280891b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:49.039117 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cfec9578-4556-4d2d-a316-6e51280891b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:49.039622 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cfec9578-4556-4d2d-a316-6e51280891b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:49.040053 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cfec9578-4556-4d2d-a316-6e51280891b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:49.040752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cfec9578-4556-4d2d-a316-6e51280891b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:49.041216 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cfec9578-4556-4d2d-a316-6e51280891b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:49.041648 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cfec9578-4556-4d2d-a316-6e51280891b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:49.064971 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-310f26a1-c323-4392-806b-f85b83a3268e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:49.067299 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-310f26a1-c323-4392-806b-f85b83a3268e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:49.074579 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-310f26a1-c323-4392-806b-f85b83a3268e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:49.075176 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-310f26a1-c323-4392-806b-f85b83a3268e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:49.075621 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-310f26a1-c323-4392-806b-f85b83a3268e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:49.076327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-310f26a1-c323-4392-806b-f85b83a3268e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:49.076785 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-310f26a1-c323-4392-806b-f85b83a3268e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:49.077216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-310f26a1-c323-4392-806b-f85b83a3268e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:49.107428 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-310f26a1-c323-4392-806b-f85b83a3268e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.046461 Sep 16 08:10:49.108202 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 374/710] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:10:49 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 08:10:49.189144 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1a927a02-c5a9-4379-980f-61c64446922e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:49.189651 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1a927a02-c5a9-4379-980f-61c64446922e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:49.195613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1a927a02-c5a9-4379-980f-61c64446922e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:49.196106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1a927a02-c5a9-4379-980f-61c64446922e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:49.196549 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1a927a02-c5a9-4379-980f-61c64446922e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:49.197278 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1a927a02-c5a9-4379-980f-61c64446922e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:49.197759 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1a927a02-c5a9-4379-980f-61c64446922e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:49.198172 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1a927a02-c5a9-4379-980f-61c64446922e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:49.227052 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1a927a02-c5a9-4379-980f-61c64446922e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:10:49.269715 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cfec9578-4556-4d2d-a316-6e51280891b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:49.277897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cfec9578-4556-4d2d-a316-6e51280891b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:49.280388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cfec9578-4556-4d2d-a316-6e51280891b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:49.281540 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-cfec9578-4556-4d2d-a316-6e51280891b8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1725 microversion: 2.20 time: 0.253929 Sep 16 08:10:49.282187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 337/711] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:49 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1725 bytes in 255 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:10:49.538541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1a927a02-c5a9-4379-980f-61c64446922e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "DELETE /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 204 len: 0 microversion: 2.1 time: 0.352942 Sep 16 08:10:49.539100 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 375/712] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:10:49 2022] DELETE /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 0 bytes in 355 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:10:49.547478 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c1f3c7e6-00b6-41d6-922d-8f837726bce3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:49.548016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c1f3c7e6-00b6-41d6-922d-8f837726bce3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:49.553926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c1f3c7e6-00b6-41d6-922d-8f837726bce3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:49.554410 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c1f3c7e6-00b6-41d6-922d-8f837726bce3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:49.554875 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c1f3c7e6-00b6-41d6-922d-8f837726bce3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:49.555565 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c1f3c7e6-00b6-41d6-922d-8f837726bce3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:49.556019 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c1f3c7e6-00b6-41d6-922d-8f837726bce3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:49.556442 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c1f3c7e6-00b6-41d6-922d-8f837726bce3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:49.710582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-3a10f1bc-2c4c-4fb4-9808-f4a7e402d001 req-81bfb9e8-3c9c-436e-bd17-fde53ce5f7d6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c", "name": "network-vif-deleted", "tag": "0104ad2b-b1c9-455f-a512-cdc1dd34408e"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:49.717596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c1f3c7e6-00b6-41d6-922d-8f837726bce3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:49.733122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c1f3c7e6-00b6-41d6-922d-8f837726bce3 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1688 microversion: 2.1 time: 0.189494 Sep 16 08:10:49.733969 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 338/713] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:49 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1688 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:10:49.735910 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-3a10f1bc-2c4c-4fb4-9808-f4a7e402d001 req-81bfb9e8-3c9c-436e-bd17-fde53ce5f7d6 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:49.736649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-3a10f1bc-2c4c-4fb4-9808-f4a7e402d001 req-81bfb9e8-3c9c-436e-bd17-fde53ce5f7d6 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:49.737242 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-3a10f1bc-2c4c-4fb4-9808-f4a7e402d001 req-81bfb9e8-3c9c-436e-bd17-fde53ce5f7d6 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:49.750229 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=4,nova_cell1:UPDATE=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:49.759316 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-3a10f1bc-2c4c-4fb4-9808-f4a7e402d001 req-81bfb9e8-3c9c-436e-bd17-fde53ce5f7d6 service nova] Creating event network-vif-deleted:0104ad2b-b1c9-455f-a512-cdc1dd34408e for instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c on hv-cinder-74014 Sep 16 08:10:49.764975 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-3a10f1bc-2c4c-4fb4-9808-f4a7e402d001 req-81bfb9e8-3c9c-436e-bd17-fde53ce5f7d6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.124364 Sep 16 08:10:49.766052 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 376/714] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:10:49 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 126 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:50.308371 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1fe174e8-e42b-4fa0-9257-124aae81eb82 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:50.310883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1fe174e8-e42b-4fa0-9257-124aae81eb82 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:50.318319 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1fe174e8-e42b-4fa0-9257-124aae81eb82 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:50.323627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1fe174e8-e42b-4fa0-9257-124aae81eb82 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:50.323627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1fe174e8-e42b-4fa0-9257-124aae81eb82 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:50.323627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1fe174e8-e42b-4fa0-9257-124aae81eb82 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:50.323627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1fe174e8-e42b-4fa0-9257-124aae81eb82 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:50.324039 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1fe174e8-e42b-4fa0-9257-124aae81eb82 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:50.387244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1fe174e8-e42b-4fa0-9257-124aae81eb82 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:50.395614 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1fe174e8-e42b-4fa0-9257-124aae81eb82 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:50.397112 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1fe174e8-e42b-4fa0-9257-124aae81eb82 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:50.398263 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1fe174e8-e42b-4fa0-9257-124aae81eb82 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1657 microversion: 2.20 time: 0.094620 Sep 16 08:10:50.398841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 339/715] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:50 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1657 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:10:50.757907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b67678e2-2ac2-464a-9737-673552d91921 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:50.758660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b67678e2-2ac2-464a-9737-673552d91921 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:50.765139 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b67678e2-2ac2-464a-9737-673552d91921 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:50.765620 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b67678e2-2ac2-464a-9737-673552d91921 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:50.766056 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b67678e2-2ac2-464a-9737-673552d91921 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:50.766780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b67678e2-2ac2-464a-9737-673552d91921 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:50.767284 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b67678e2-2ac2-464a-9737-673552d91921 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:50.772208 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b67678e2-2ac2-464a-9737-673552d91921 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:50.899196 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b67678e2-2ac2-464a-9737-673552d91921 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:50.907815 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b67678e2-2ac2-464a-9737-673552d91921 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1688 microversion: 2.1 time: 0.154995 Sep 16 08:10:50.908387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 377/716] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:50 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1688 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:51.423791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d4805692-5811-4dea-a281-8ea71804b9da tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:51.424444 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d4805692-5811-4dea-a281-8ea71804b9da tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:51.431296 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d4805692-5811-4dea-a281-8ea71804b9da tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:51.431770 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d4805692-5811-4dea-a281-8ea71804b9da tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:51.432204 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d4805692-5811-4dea-a281-8ea71804b9da tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:51.432884 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d4805692-5811-4dea-a281-8ea71804b9da tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:51.433331 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d4805692-5811-4dea-a281-8ea71804b9da tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:51.433759 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d4805692-5811-4dea-a281-8ea71804b9da tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:51.494106 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d4805692-5811-4dea-a281-8ea71804b9da tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:51.502709 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d4805692-5811-4dea-a281-8ea71804b9da tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:51.505127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d4805692-5811-4dea-a281-8ea71804b9da tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:51.505310 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d4805692-5811-4dea-a281-8ea71804b9da tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1657 microversion: 2.20 time: 0.085646 Sep 16 08:10:51.505848 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 340/717] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:51 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1657 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:10:51.931359 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9123b157-9f51-4dc9-b12a-37b2889371a0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:51.932069 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-9123b157-9f51-4dc9-b12a-37b2889371a0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:51.939149 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9123b157-9f51-4dc9-b12a-37b2889371a0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:51.939780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9123b157-9f51-4dc9-b12a-37b2889371a0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:51.940228 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9123b157-9f51-4dc9-b12a-37b2889371a0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:51.940923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9123b157-9f51-4dc9-b12a-37b2889371a0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:51.941386 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9123b157-9f51-4dc9-b12a-37b2889371a0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:51.941836 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9123b157-9f51-4dc9-b12a-37b2889371a0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:52.066931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-9123b157-9f51-4dc9-b12a-37b2889371a0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:52.074604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9123b157-9f51-4dc9-b12a-37b2889371a0 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1688 microversion: 2.1 time: 0.147125 Sep 16 08:10:52.075199 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 378/718] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:51 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1688 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:52.532563 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f2e0afcb-ed43-4279-b670-2dbffb82dc47 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:52.533172 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f2e0afcb-ed43-4279-b670-2dbffb82dc47 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:52.539640 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2e0afcb-ed43-4279-b670-2dbffb82dc47 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:52.540123 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2e0afcb-ed43-4279-b670-2dbffb82dc47 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:52.540566 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2e0afcb-ed43-4279-b670-2dbffb82dc47 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:52.541254 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2e0afcb-ed43-4279-b670-2dbffb82dc47 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:52.541709 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2e0afcb-ed43-4279-b670-2dbffb82dc47 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:52.542136 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f2e0afcb-ed43-4279-b670-2dbffb82dc47 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:52.605651 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f2e0afcb-ed43-4279-b670-2dbffb82dc47 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:52.613717 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f2e0afcb-ed43-4279-b670-2dbffb82dc47 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:52.615192 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f2e0afcb-ed43-4279-b670-2dbffb82dc47 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:52.616372 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f2e0afcb-ed43-4279-b670-2dbffb82dc47 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1657 microversion: 2.20 time: 0.088591 Sep 16 08:10:52.616934 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 341/719] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:52 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1657 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:10:53.097109 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3c3319ae-1f53-4b3c-8948-b6daad883344 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:53.097649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3c3319ae-1f53-4b3c-8948-b6daad883344 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:53.104050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c3319ae-1f53-4b3c-8948-b6daad883344 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:53.104534 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c3319ae-1f53-4b3c-8948-b6daad883344 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:53.104971 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c3319ae-1f53-4b3c-8948-b6daad883344 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:53.105656 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c3319ae-1f53-4b3c-8948-b6daad883344 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:53.106111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c3319ae-1f53-4b3c-8948-b6daad883344 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:53.106530 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3c3319ae-1f53-4b3c-8948-b6daad883344 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:53.239366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3c3319ae-1f53-4b3c-8948-b6daad883344 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:53.247023 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3c3319ae-1f53-4b3c-8948-b6daad883344 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1688 microversion: 2.1 time: 0.153790 Sep 16 08:10:53.247610 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 379/720] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:53 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1688 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:53.642162 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:53.642755 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:53.649109 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:53.649597 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:53.650042 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:53.650779 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:53.651241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:53.651672 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:53.683712 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:53.683975 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:53.684614 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:53.685562 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lazy-loading 'fault' on Instance uuid 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:10:53.763664 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:53.772217 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:53.773691 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:53.774883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a81cf728-8108-46cb-9c3b-c6b88feb811b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 200 len: 1372 microversion: 2.20 time: 0.137308 Sep 16 08:10:53.775471 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 342/721] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:53 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 1372 bytes in 139 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:10:54.222246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-561ee0e2-e754-4527-953c-68771b05e5ac req-de9398dd-1ba0-45db-b901-429a732b01d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "5e79005e-be5d-4326-aa8d-28bdef7f1a3b", "name": "network-vif-deleted", "tag": "e41ec44c-439a-45a5-9e2e-66947ff6004f"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:54.233162 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-561ee0e2-e754-4527-953c-68771b05e5ac req-de9398dd-1ba0-45db-b901-429a732b01d1 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:54.241228 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-561ee0e2-e754-4527-953c-68771b05e5ac req-de9398dd-1ba0-45db-b901-429a732b01d1 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:54.241228 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-561ee0e2-e754-4527-953c-68771b05e5ac req-de9398dd-1ba0-45db-b901-429a732b01d1 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:54.246995 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-561ee0e2-e754-4527-953c-68771b05e5ac req-de9398dd-1ba0-45db-b901-429a732b01d1 service nova] Creating event network-vif-deleted:e41ec44c-439a-45a5-9e2e-66947ff6004f for instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b on hv-cinder-74014 Sep 16 08:10:54.252484 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-561ee0e2-e754-4527-953c-68771b05e5ac req-de9398dd-1ba0-45db-b901-429a732b01d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.035197 Sep 16 08:10:54.253090 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 380/722] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:10:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:54.269696 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-28a344ae-a812-44d0-a3d0-9efcd35d8150 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:54.270511 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-28a344ae-a812-44d0-a3d0-9efcd35d8150 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:54.276947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28a344ae-a812-44d0-a3d0-9efcd35d8150 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:54.278559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28a344ae-a812-44d0-a3d0-9efcd35d8150 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:54.279477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28a344ae-a812-44d0-a3d0-9efcd35d8150 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:54.280822 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28a344ae-a812-44d0-a3d0-9efcd35d8150 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:54.281528 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28a344ae-a812-44d0-a3d0-9efcd35d8150 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:54.282279 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28a344ae-a812-44d0-a3d0-9efcd35d8150 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:54.363953 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-28a344ae-a812-44d0-a3d0-9efcd35d8150 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:54.373113 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-28a344ae-a812-44d0-a3d0-9efcd35d8150 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1621 microversion: 2.1 time: 0.107575 Sep 16 08:10:54.387353 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 343/723] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:54 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1621 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:54.803240 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e0e3c0cc-46d1-4787-940c-da135936c8c7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:54.803938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e0e3c0cc-46d1-4787-940c-da135936c8c7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:54.810604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e0e3c0cc-46d1-4787-940c-da135936c8c7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:54.811148 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e0e3c0cc-46d1-4787-940c-da135936c8c7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:54.812072 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e0e3c0cc-46d1-4787-940c-da135936c8c7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:54.812252 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e0e3c0cc-46d1-4787-940c-da135936c8c7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:54.812711 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e0e3c0cc-46d1-4787-940c-da135936c8c7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:54.813139 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e0e3c0cc-46d1-4787-940c-da135936c8c7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:54.826674 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-e0e3c0cc-46d1-4787-940c-da135936c8c7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] HTTP exception thrown: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e0e3c0cc-46d1-4787-940c-da135936c8c7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Request method failure captured: Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c HTTP/1.1 Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC6irA81AAf42vHmJutRQNC5aIfjl28CScTLRSYiVLMIrEjHIRUJoW_TDTAPgb3885lU7_saUm9szGSmcBJMD4OpUOsfh0qr9JW64prMC6IJLX8ne5HWwv1CdZ8_88uBPEk8juWCp-JYXJiYX9UvyQ1E3azOFoHGQU3NEBRQcRWJuec Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 8191457181714862bbeb70259fa86971 Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:10:54.828448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:10:54.830184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8191457181714862bbeb70259fa86971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8191457181714862bbeb70259fa86971"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8191457181714862bbeb70259fa86971", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8191457181714862bbeb70259fa86971"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:10:54.830184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:10:54.830184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 8191457181714862bbeb70259fa86971 Sep 16 08:10:54.830184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:10:54.830184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-AttachVolumeShelveTestJSON-665464524-project Sep 16 08:10:54.830184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:10:54.830184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:10:54.830184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: 81e89f8fb70d49d18cd0c81c98dd4add Sep 16 08:10:54.830184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-AttachVolumeShelveTestJSON-665464524-project Sep 16 08:10:54.830184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:10:54.830184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:10:54.830184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c'} Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:10:54.831118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:10:54.832604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:54.833893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e0e3c0cc-46d1-4787-940c-da135936c8c7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Returning 404 to user: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:10:54.833893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e0e3c0cc-46d1-4787-940c-da135936c8c7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 404 len: 111 microversion: 2.20 time: 0.030938 Sep 16 08:10:54.833893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 381/724] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:54 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 16 08:10:54.838901 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ca18d18b-0d03-483e-8bee-658894e00ce2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '.version_select at 0x7f9d067b8a60>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:54.911220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ca18d18b-0d03-483e-8bee-658894e00ce2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595443651" status: 204 len: 0 microversion: 2.20 time: 0.076148 Sep 16 08:10:54.911855 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 344/725] 10.222.0.59 () {60 vars in 1262 bytes} [Fri Sep 16 08:10:54 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1595443651 => generated 0 bytes in 77 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 08:10:55.397840 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:55.398514 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:55.406559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:55.407070 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:55.407532 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:55.408233 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:55.408672 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:55.409113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:55.441926 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:55.442408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:55.442890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:55.443349 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lazy-loading 'fault' on Instance uuid 5e79005e-be5d-4326-aa8d-28bdef7f1a3b {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:10:55.485598 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:55.493552 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f5643297-43b3-41e9-8aa5-6716a851ee31 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 200 len: 1335 microversion: 2.1 time: 0.099870 Sep 16 08:10:55.495267 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 382/726] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:55 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 1335 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:10:55.677902 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-541e4036-f807-4f2d-a585-0db741643125 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Action: 'create', calling method: .version_select at 0x7f9d0681fa60>, body: {"keypair": {"name": "tempest-keypair-1972670979", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBJTu818noNlrZTba/Ca5RrBwjMM/LAykYLEqCIoP62hBoJC3W20TSy7SazSrvhT8JrO5Z2fU8AOwzq3J2jeUywUlm17V0yyQQEotQEu41qC6wKO2Sudr7PV/KPaKPpJWSg=="}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:55.696061 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-541e4036-f807-4f2d-a585-0db741643125 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Getting quotas for project 8191457181714862bbeb70259fa86971. Resources: {'key_pairs'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:10:55.699845 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-541e4036-f807-4f2d-a585-0db741643125 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Getting quotas for user 81e89f8fb70d49d18cd0c81c98dd4add and project 8191457181714862bbeb70259fa86971. Resources: {'key_pairs'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:10:55.768532 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-541e4036-f807-4f2d-a585-0db741643125 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 201 len: 401 microversion: 2.20 time: 0.094387 Sep 16 08:10:55.769130 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 345/727] 10.222.0.59 () {62 vars in 1200 bytes} [Fri Sep 16 08:10:55 2022] POST /compute/v2.1/os-keypairs => generated 401 bytes in 96 msecs (HTTP/1.1 201) 9 headers in 364 bytes (1 switches on core 0) Sep 16 08:10:56.517439 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0178e626-a55d-40ec-b496-5b743570a9e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:56.518059 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0178e626-a55d-40ec-b496-5b743570a9e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: 5e79005e-be5d-4326-aa8d-28bdef7f1a3b] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:56.524654 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0178e626-a55d-40ec-b496-5b743570a9e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:56.525233 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0178e626-a55d-40ec-b496-5b743570a9e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:56.525570 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0178e626-a55d-40ec-b496-5b743570a9e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:56.526267 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0178e626-a55d-40ec-b496-5b743570a9e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:56.526750 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0178e626-a55d-40ec-b496-5b743570a9e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:56.527180 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0178e626-a55d-40ec-b496-5b743570a9e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-0178e626-a55d-40ec-b496-5b743570a9e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] HTTP exception thrown: Instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b could not be found. Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0178e626-a55d-40ec-b496-5b743570a9e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Request method failure captured: Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b HTTP/1.1 Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5GXkI7GeumBIhNBFf_vC-zlSOiV4dCShrtm4bkI4LE1i-bWnSTTdrg8lDXop79dMBvn6k727VeIZ9RUTBYYG88b4loy74GTRNMsNeOg1LluL0TmiejGYMmPZSLUag59Xa3AoJLUqBLHggHqVQT8xsY47QGvGbWk6SSJElkQSuFN5w Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: f143f731c6cc4b38ba979827cd390f77 Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:10:56.554463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:10:56.556420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f143f731c6cc4b38ba979827cd390f77", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:10:56.556420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:10:56.556420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: f143f731c6cc4b38ba979827cd390f77 Sep 16 08:10:56.556420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:10:56.556420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-ServerRescueNegativeTestJSON-481869959-project Sep 16 08:10:56.556420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:10:56.556420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:10:56.556420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: 5a85cff936184b5d94375fd103493950 Sep 16 08:10:56.556420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-ServerRescueNegativeTestJSON-481869959-project Sep 16 08:10:56.556420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:10:56.556420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b could not be found. Sep 16 08:10:56.556420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '5e79005e-be5d-4326-aa8d-28bdef7f1a3b'} Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b could not be found. Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:10:56.557170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b could not be found. Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b could not be found. Sep 16 08:10:56.558382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:56.559505 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0178e626-a55d-40ec-b496-5b743570a9e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Returning 404 to user: Instance 5e79005e-be5d-4326-aa8d-28bdef7f1a3b could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:10:56.559505 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0178e626-a55d-40ec-b496-5b743570a9e9 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b" status: 404 len: 111 microversion: 2.1 time: 0.039657 Sep 16 08:10:56.559505 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 383/728] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:56 2022] GET /compute/v2.1/servers/5e79005e-be5d-4326-aa8d-28bdef7f1a3b => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:10:56.562611 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d16b5f7c-ab39-4e1d-9609-648f3acc9334 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '.version_select at 0x7f9d0681f160>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:56.711015 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d16b5f7c-ab39-4e1d-9609-648f3acc9334 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1395195768" status: 202 len: 0 microversion: 2.1 time: 0.153328 Sep 16 08:10:56.712164 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 346/729] 10.222.0.59 () {58 vars in 1221 bytes} [Fri Sep 16 08:10:56 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1395195768 => generated 0 bytes in 155 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:10:56.755235 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b4ab66ae-6a0a-4851-9408-183d2bf4670d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "92a8939f-1da0-4f5a-a77a-fd4b1e91734d"}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:56.757840 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b4ab66ae-6a0a-4851-9408-183d2bf4670d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:56.764384 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b4ab66ae-6a0a-4851-9408-183d2bf4670d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:56.764874 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b4ab66ae-6a0a-4851-9408-183d2bf4670d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:56.765316 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b4ab66ae-6a0a-4851-9408-183d2bf4670d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:56.766044 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b4ab66ae-6a0a-4851-9408-183d2bf4670d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:56.766506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b4ab66ae-6a0a-4851-9408-183d2bf4670d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:56.766958 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b4ab66ae-6a0a-4851-9408-183d2bf4670d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:56.849885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-b4ab66ae-6a0a-4851-9408-183d2bf4670d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Invalid volume: volume 92a8939f-1da0-4f5a-a77a-fd4b1e91734d is already attached to instances: ea13dc92-1066-46f6-9fda-8d87d3721731 Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b4ab66ae-6a0a-4851-9408-183d2bf4670d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: POST /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments HTTP/1.1 Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 74 Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:10:56.851683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:10:56.853022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:10:56.853022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:10:56.853022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:10:56.853022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:10:56.853022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:10:56.853022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:10:56.853022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:10:56.853022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:10:56.853022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:10:56.853022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Sep 16 08:10:56.853022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {"volumeAttachment": {"volumeId": "92a8939f-1da0-4f5a-a77a-fd4b1e91734d"}} Sep 16 08:10:56.853022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Invalid volume: volume 92a8939f-1da0-4f5a-a77a-fd4b1e91734d is already attached to instances: ea13dc92-1066-46f6-9fda-8d87d3721731 Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'server_id': 'ea13dc92-1066-46f6-9fda-8d87d3721731', 'body': {'volumeAttachment': {'volumeId': '92a8939f-1da0-4f5a-a77a-fd4b1e91734d'}}} Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 388, in create Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi device = self.compute_api.attach_volume( Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 241, in inner Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return function(self, context, instance, *args, **kwargs) Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 167, in inner Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(self, context, instance, *args, **kw) Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 5130, in attach_volume Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi self._check_volume_already_attached(context, instance, volume) Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 4970, in _check_volume_already_attached Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InvalidVolume(reason=msg) Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InvalidVolume: Invalid volume: volume 92a8939f-1da0-4f5a-a77a-fd4b1e91734d is already attached to instances: ea13dc92-1066-46f6-9fda-8d87d3721731 Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:56.853771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 110, in wrapper Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func(*args, **kwargs) Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 406, in create Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPBadRequest(explanation=e.format_message()) Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPBadRequest: Invalid volume: volume 92a8939f-1da0-4f5a-a77a-fd4b1e91734d is already attached to instances: ea13dc92-1066-46f6-9fda-8d87d3721731 Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:10:56.855497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:10:56.857774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:10:56.857774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:10:56.857774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:10:56.857774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid volume: volume 92a8939f-1da0-4f5a-a77a-fd4b1e91734d is already attached to instances: ea13dc92-1066-46f6-9fda-8d87d3721731 Sep 16 08:10:56.857774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:10:56.857774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b4ab66ae-6a0a-4851-9408-183d2bf4670d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 400 to user: Invalid volume: volume 92a8939f-1da0-4f5a-a77a-fd4b1e91734d is already attached to instances: ea13dc92-1066-46f6-9fda-8d87d3721731 {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:10:56.857774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b4ab66ae-6a0a-4851-9408-183d2bf4670d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments" status: 400 len: 174 microversion: 2.1 time: 0.101990 Sep 16 08:10:56.857774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 384/730] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:10:56 2022] POST /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments => generated 174 bytes in 103 msecs (HTTP/1.1 400) 9 headers in 381 bytes (1 switches on core 0) Sep 16 08:10:56.920706 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e7a260dc-cc03-4742-8138-26627d23cc0f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:56.921198 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e7a260dc-cc03-4742-8138-26627d23cc0f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:56.927073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e7a260dc-cc03-4742-8138-26627d23cc0f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:56.930468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e7a260dc-cc03-4742-8138-26627d23cc0f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:56.930468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e7a260dc-cc03-4742-8138-26627d23cc0f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:56.930468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e7a260dc-cc03-4742-8138-26627d23cc0f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:56.930468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e7a260dc-cc03-4742-8138-26627d23cc0f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:56.930854 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e7a260dc-cc03-4742-8138-26627d23cc0f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:57.022091 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:10:57.027600 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-e7a260dc-cc03-4742-8138-26627d23cc0f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lazy-loading 'services' on Instance uuid ea13dc92-1066-46f6-9fda-8d87d3721731 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:10:57.246803 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e7a260dc-cc03-4742-8138-26627d23cc0f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments/92a8939f-1da0-4f5a-a77a-fd4b1e91734d" status: 202 len: 0 microversion: 2.1 time: 0.329883 Sep 16 08:10:57.248513 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 347/731] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Sep 16 08:10:56 2022] DELETE /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments/92a8939f-1da0-4f5a-a77a-fd4b1e91734d => generated 0 bytes in 333 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:10:57.257471 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5e1b8fc0-b58d-4e7a-8d3d-8ad80641b051 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:57.260081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5e1b8fc0-b58d-4e7a-8d3d-8ad80641b051 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:57.269009 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1b8fc0-b58d-4e7a-8d3d-8ad80641b051 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:57.269790 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1b8fc0-b58d-4e7a-8d3d-8ad80641b051 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:57.270461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1b8fc0-b58d-4e7a-8d3d-8ad80641b051 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:57.271201 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1b8fc0-b58d-4e7a-8d3d-8ad80641b051 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:57.271824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1b8fc0-b58d-4e7a-8d3d-8ad80641b051 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:57.272250 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1b8fc0-b58d-4e7a-8d3d-8ad80641b051 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:57.303469 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5e1b8fc0-b58d-4e7a-8d3d-8ad80641b051 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050620 Sep 16 08:10:57.304043 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 385/732] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:10:57 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments => generated 197 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:58.142780 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeShelveTestJSON-server-1113992180", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "98ee904d-e719-4f43-92f8-977801b2d6d2"}], "security_groups": [{"name": "tempest-securitygroup--801968477"}], "key_name": "tempest-keypair-1972670979", "user_data": "}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:10:58.248300 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.network.neutron [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] validate_networks() for [('98ee904d-e719-4f43-92f8-977801b2d6d2', None, None, None, None, None)] {{(pid=121047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:10:58.317022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1343916c-ab06-445d-a207-13a852b8d24c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:58.319184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1343916c-ab06-445d-a207-13a852b8d24c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:58.325553 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1343916c-ab06-445d-a207-13a852b8d24c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:58.326574 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1343916c-ab06-445d-a207-13a852b8d24c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:58.327050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1343916c-ab06-445d-a207-13a852b8d24c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:58.327744 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1343916c-ab06-445d-a207-13a852b8d24c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:58.328197 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1343916c-ab06-445d-a207-13a852b8d24c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:58.328621 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1343916c-ab06-445d-a207-13a852b8d24c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:58.357718 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1343916c-ab06-445d-a207-13a852b8d24c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.044649 Sep 16 08:10:58.358282 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 386/733] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:10:58 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments => generated 197 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:10:58.667054 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Flavor limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:10:58.667480 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Image limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:10:58.667951 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Flavor pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:10:58.668359 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Image pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:10:58.668839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:10:58.677969 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:58.678387 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:58.678869 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:58.679581 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:58.680033 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:58.681582 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:58.697331 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Getting quotas for project 8191457181714862bbeb70259fa86971. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:10:58.701248 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Getting quotas for user 81e89f8fb70d49d18cd0c81c98dd4add and project 8191457181714862bbeb70259fa86971. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:10:58.711988 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Going to run 1 instances... {{(pid=121047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:10:58.714348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:10:58.841760 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-904c3dfc-95bf-447d-870b-997e96b743e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.20 time: 0.704348 Sep 16 08:10:58.842411 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 348/734] 10.222.0.59 () {62 vars in 1188 bytes} [Fri Sep 16 08:10:58 2022] POST /compute/v2.1/servers => generated 401 bytes in 706 msecs (HTTP/1.1 202) 10 headers in 453 bytes (1 switches on core 0) Sep 16 08:10:58.853311 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b8139684-d513-4133-9773-31d0865b1eb8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:58.853961 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b8139684-d513-4133-9773-31d0865b1eb8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:58.913289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b8139684-d513-4133-9773-31d0865b1eb8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:58.921291 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b8139684-d513-4133-9773-31d0865b1eb8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:58.922769 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b8139684-d513-4133-9773-31d0865b1eb8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:10:58.923859 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b8139684-d513-4133-9773-31d0865b1eb8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1282 microversion: 2.20 time: 0.074391 Sep 16 08:10:58.924416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 387/735] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:58 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1282 bytes in 75 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:10:59.370134 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-45bfb893-84c7-4905-8a91-65d515438da1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:59.372519 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-45bfb893-84c7-4905-8a91-65d515438da1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:59.379702 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-45bfb893-84c7-4905-8a91-65d515438da1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:59.382466 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-45bfb893-84c7-4905-8a91-65d515438da1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:59.382466 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-45bfb893-84c7-4905-8a91-65d515438da1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:59.382466 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-45bfb893-84c7-4905-8a91-65d515438da1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:59.382466 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-45bfb893-84c7-4905-8a91-65d515438da1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:59.382859 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-45bfb893-84c7-4905-8a91-65d515438da1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:59.412738 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-45bfb893-84c7-4905-8a91-65d515438da1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047091 Sep 16 08:10:59.413310 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 349/736] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:10:59 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 08:10:59.480813 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-efa968b3-337e-4fd4-ae2e-5a7d2218620b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:59.481330 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-efa968b3-337e-4fd4-ae2e-5a7d2218620b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:59.487831 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-efa968b3-337e-4fd4-ae2e-5a7d2218620b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:59.488317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-efa968b3-337e-4fd4-ae2e-5a7d2218620b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:59.488757 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-efa968b3-337e-4fd4-ae2e-5a7d2218620b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:59.489448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-efa968b3-337e-4fd4-ae2e-5a7d2218620b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:59.489943 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-efa968b3-337e-4fd4-ae2e-5a7d2218620b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:59.490374 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-efa968b3-337e-4fd4-ae2e-5a7d2218620b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:59.516408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-efa968b3-337e-4fd4-ae2e-5a7d2218620b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:10:59.875777 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-efa968b3-337e-4fd4-ae2e-5a7d2218620b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 204 len: 0 microversion: 2.1 time: 0.398468 Sep 16 08:10:59.876330 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 388/737] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:10:59 2022] DELETE /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 0 bytes in 400 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:10:59.884603 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7a74f9b9-3131-4efd-8564-98ef0af6b154 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:59.885203 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7a74f9b9-3131-4efd-8564-98ef0af6b154 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:59.891897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7a74f9b9-3131-4efd-8564-98ef0af6b154 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:59.892382 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7a74f9b9-3131-4efd-8564-98ef0af6b154 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:59.892819 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7a74f9b9-3131-4efd-8564-98ef0af6b154 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:59.893514 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7a74f9b9-3131-4efd-8564-98ef0af6b154 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:59.893971 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7a74f9b9-3131-4efd-8564-98ef0af6b154 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:59.894398 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7a74f9b9-3131-4efd-8564-98ef0af6b154 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:59.950266 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4ed3fa02-03c8-4072-b6c9-90b2afbbee35 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:10:59.951649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4ed3fa02-03c8-4072-b6c9-90b2afbbee35 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:10:59.957625 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ed3fa02-03c8-4072-b6c9-90b2afbbee35 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:59.958192 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ed3fa02-03c8-4072-b6c9-90b2afbbee35 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:59.958728 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ed3fa02-03c8-4072-b6c9-90b2afbbee35 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:10:59.964453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ed3fa02-03c8-4072-b6c9-90b2afbbee35 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:10:59.964453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ed3fa02-03c8-4072-b6c9-90b2afbbee35 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:10:59.964453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ed3fa02-03c8-4072-b6c9-90b2afbbee35 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:00.024594 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7a74f9b9-3131-4efd-8564-98ef0af6b154 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:00.032724 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7a74f9b9-3131-4efd-8564-98ef0af6b154 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1681 microversion: 2.1 time: 0.152015 Sep 16 08:11:00.033430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 350/738] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:10:59 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1681 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:00.035469 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4ed3fa02-03c8-4072-b6c9-90b2afbbee35 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:00.043768 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4ed3fa02-03c8-4072-b6c9-90b2afbbee35 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:00.045742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4ed3fa02-03c8-4072-b6c9-90b2afbbee35 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:00.046879 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4ed3fa02-03c8-4072-b6c9-90b2afbbee35 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1286 microversion: 2.20 time: 0.101103 Sep 16 08:11:00.047435 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 389/739] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:10:59 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1286 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:11:00.154055 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4d6a6171-9625-4ecf-a6fe-51f8c4b5af97 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:00.154550 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4d6a6171-9625-4ecf-a6fe-51f8c4b5af97 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:00.160792 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d6a6171-9625-4ecf-a6fe-51f8c4b5af97 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:00.161277 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d6a6171-9625-4ecf-a6fe-51f8c4b5af97 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:00.161719 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d6a6171-9625-4ecf-a6fe-51f8c4b5af97 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:00.162416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d6a6171-9625-4ecf-a6fe-51f8c4b5af97 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:00.163046 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d6a6171-9625-4ecf-a6fe-51f8c4b5af97 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:00.163482 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d6a6171-9625-4ecf-a6fe-51f8c4b5af97 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:00.189232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4d6a6171-9625-4ecf-a6fe-51f8c4b5af97 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Going to try to terminate instance {{(pid=121047) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:11:00.417725 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4d6a6171-9625-4ecf-a6fe-51f8c4b5af97 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "DELETE /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 204 len: 0 microversion: 2.1 time: 0.267171 Sep 16 08:11:00.418412 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 351/740] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:11:00 2022] DELETE /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 0 bytes in 269 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:11:00.427011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8a4d25c7-83f7-40a2-a75b-af8bb08588ce tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:00.427618 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8a4d25c7-83f7-40a2-a75b-af8bb08588ce tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:00.433461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a4d25c7-83f7-40a2-a75b-af8bb08588ce tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:00.433946 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a4d25c7-83f7-40a2-a75b-af8bb08588ce tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:00.434383 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a4d25c7-83f7-40a2-a75b-af8bb08588ce tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:00.435131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a4d25c7-83f7-40a2-a75b-af8bb08588ce tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:00.435593 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a4d25c7-83f7-40a2-a75b-af8bb08588ce tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:00.436015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a4d25c7-83f7-40a2-a75b-af8bb08588ce tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:00.561318 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8a4d25c7-83f7-40a2-a75b-af8bb08588ce tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:00.568914 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8a4d25c7-83f7-40a2-a75b-af8bb08588ce tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1507 microversion: 2.1 time: 0.145734 Sep 16 08:11:00.569473 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 390/741] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:00 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1507 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:01.057260 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a6cf6538-3040-40db-8146-0c26a2c5279c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:01.057919 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a6cf6538-3040-40db-8146-0c26a2c5279c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:01.064321 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a6cf6538-3040-40db-8146-0c26a2c5279c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:01.064798 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a6cf6538-3040-40db-8146-0c26a2c5279c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:01.065235 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a6cf6538-3040-40db-8146-0c26a2c5279c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:01.065925 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a6cf6538-3040-40db-8146-0c26a2c5279c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:01.066462 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a6cf6538-3040-40db-8146-0c26a2c5279c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:01.066994 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a6cf6538-3040-40db-8146-0c26a2c5279c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:01.071707 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-fdcac4c1-4043-4a2e-a933-9dfb96d860ea tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:01.074471 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-fdcac4c1-4043-4a2e-a933-9dfb96d860ea tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:01.078975 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fdcac4c1-4043-4a2e-a933-9dfb96d860ea tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:01.079458 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fdcac4c1-4043-4a2e-a933-9dfb96d860ea tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:01.079896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fdcac4c1-4043-4a2e-a933-9dfb96d860ea tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:01.080627 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fdcac4c1-4043-4a2e-a933-9dfb96d860ea tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:01.081078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fdcac4c1-4043-4a2e-a933-9dfb96d860ea tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:01.081502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fdcac4c1-4043-4a2e-a933-9dfb96d860ea tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:01.141893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-fdcac4c1-4043-4a2e-a933-9dfb96d860ea tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:01.150202 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-fdcac4c1-4043-4a2e-a933-9dfb96d860ea tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:01.151704 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-fdcac4c1-4043-4a2e-a933-9dfb96d860ea tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:01.152813 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-fdcac4c1-4043-4a2e-a933-9dfb96d860ea tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1286 microversion: 2.20 time: 0.085100 Sep 16 08:11:01.153371 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 391/742] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:01 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1286 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:11:01.198113 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a6cf6538-3040-40db-8146-0c26a2c5279c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:01.206646 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a6cf6538-3040-40db-8146-0c26a2c5279c tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1681 microversion: 2.1 time: 0.153766 Sep 16 08:11:01.207244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 352/743] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:01 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1681 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:01.590761 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5e320cc7-7b8b-42cd-9b6c-3cc9423ffcb7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:01.591402 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5e320cc7-7b8b-42cd-9b6c-3cc9423ffcb7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:01.597745 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e320cc7-7b8b-42cd-9b6c-3cc9423ffcb7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:01.598229 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e320cc7-7b8b-42cd-9b6c-3cc9423ffcb7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:01.598669 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e320cc7-7b8b-42cd-9b6c-3cc9423ffcb7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:01.599387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e320cc7-7b8b-42cd-9b6c-3cc9423ffcb7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:01.599847 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e320cc7-7b8b-42cd-9b6c-3cc9423ffcb7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:01.600274 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e320cc7-7b8b-42cd-9b6c-3cc9423ffcb7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:01.731473 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5e320cc7-7b8b-42cd-9b6c-3cc9423ffcb7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:01.740052 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5e320cc7-7b8b-42cd-9b6c-3cc9423ffcb7 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1507 microversion: 2.1 time: 0.153132 Sep 16 08:11:01.741571 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 392/744] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:01 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1507 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:02.177346 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0c913907-5e63-446c-8995-0742034c50e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:02.177954 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0c913907-5e63-446c-8995-0742034c50e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:02.184511 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0c913907-5e63-446c-8995-0742034c50e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:02.184987 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0c913907-5e63-446c-8995-0742034c50e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:02.185418 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0c913907-5e63-446c-8995-0742034c50e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:02.186108 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0c913907-5e63-446c-8995-0742034c50e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:02.186556 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0c913907-5e63-446c-8995-0742034c50e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:02.187001 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0c913907-5e63-446c-8995-0742034c50e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:02.229800 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-fff9c2c9-5252-4247-be9c-0f50068f339d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:02.230413 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-fff9c2c9-5252-4247-be9c-0f50068f339d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:02.236865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fff9c2c9-5252-4247-be9c-0f50068f339d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:02.237356 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fff9c2c9-5252-4247-be9c-0f50068f339d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:02.237799 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fff9c2c9-5252-4247-be9c-0f50068f339d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:02.238508 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fff9c2c9-5252-4247-be9c-0f50068f339d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:02.238998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fff9c2c9-5252-4247-be9c-0f50068f339d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:02.243907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fff9c2c9-5252-4247-be9c-0f50068f339d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:02.375296 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-fff9c2c9-5252-4247-be9c-0f50068f339d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:02.383009 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-fff9c2c9-5252-4247-be9c-0f50068f339d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1681 microversion: 2.1 time: 0.157278 Sep 16 08:11:02.383596 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 393/745] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:02 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1681 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:11:02.407029 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0c913907-5e63-446c-8995-0742034c50e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:02.412412 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0c913907-5e63-446c-8995-0742034c50e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:02.413866 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0c913907-5e63-446c-8995-0742034c50e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:02.414987 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0c913907-5e63-446c-8995-0742034c50e6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1286 microversion: 2.20 time: 0.241510 Sep 16 08:11:02.415611 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 353/746] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:02 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1286 bytes in 243 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:11:02.763755 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-213d9dd5-2fba-415a-8da4-5ce32dd2a4d2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:02.764370 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-213d9dd5-2fba-415a-8da4-5ce32dd2a4d2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:02.770805 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-213d9dd5-2fba-415a-8da4-5ce32dd2a4d2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:02.771295 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-213d9dd5-2fba-415a-8da4-5ce32dd2a4d2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:02.771735 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-213d9dd5-2fba-415a-8da4-5ce32dd2a4d2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:02.772431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-213d9dd5-2fba-415a-8da4-5ce32dd2a4d2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:02.772887 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-213d9dd5-2fba-415a-8da4-5ce32dd2a4d2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:02.773315 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-213d9dd5-2fba-415a-8da4-5ce32dd2a4d2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:02.793021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:02.899360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-213d9dd5-2fba-415a-8da4-5ce32dd2a4d2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:02.907780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-213d9dd5-2fba-415a-8da4-5ce32dd2a4d2 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1507 microversion: 2.1 time: 0.147953 Sep 16 08:11:02.908342 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 394/747] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:02 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1507 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:03.406163 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-899333f3-d51e-4149-a542-3fccaec69cb2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:03.406824 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-899333f3-d51e-4149-a542-3fccaec69cb2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:03.413315 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-899333f3-d51e-4149-a542-3fccaec69cb2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:03.413795 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-899333f3-d51e-4149-a542-3fccaec69cb2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:03.414232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-899333f3-d51e-4149-a542-3fccaec69cb2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:03.414955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-899333f3-d51e-4149-a542-3fccaec69cb2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:03.415409 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-899333f3-d51e-4149-a542-3fccaec69cb2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:03.415838 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-899333f3-d51e-4149-a542-3fccaec69cb2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:03.440088 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-77a79910-63a5-4880-9f22-43c28534ec93 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:03.440691 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-77a79910-63a5-4880-9f22-43c28534ec93 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:03.446761 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77a79910-63a5-4880-9f22-43c28534ec93 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:03.447236 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77a79910-63a5-4880-9f22-43c28534ec93 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:03.447670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77a79910-63a5-4880-9f22-43c28534ec93 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:03.448355 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77a79910-63a5-4880-9f22-43c28534ec93 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:03.448806 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77a79910-63a5-4880-9f22-43c28534ec93 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:03.449226 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77a79910-63a5-4880-9f22-43c28534ec93 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:03.515309 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-77a79910-63a5-4880-9f22-43c28534ec93 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:03.523246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-77a79910-63a5-4880-9f22-43c28534ec93 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:03.524670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-77a79910-63a5-4880-9f22-43c28534ec93 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:03.525775 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-77a79910-63a5-4880-9f22-43c28534ec93 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1278 microversion: 2.20 time: 0.089617 Sep 16 08:11:03.526427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 395/748] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:03 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1278 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:11:03.585443 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-899333f3-d51e-4149-a542-3fccaec69cb2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:03.593238 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-899333f3-d51e-4149-a542-3fccaec69cb2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1681 microversion: 2.1 time: 0.191226 Sep 16 08:11:03.593787 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 354/749] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:03 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1681 bytes in 192 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:03.930828 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5d236385-82c9-4a2b-9ee7-f274e695c82c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:03.932044 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5d236385-82c9-4a2b-9ee7-f274e695c82c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:03.939636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5d236385-82c9-4a2b-9ee7-f274e695c82c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:03.940135 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5d236385-82c9-4a2b-9ee7-f274e695c82c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:03.940580 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5d236385-82c9-4a2b-9ee7-f274e695c82c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:03.941294 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5d236385-82c9-4a2b-9ee7-f274e695c82c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:03.941750 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5d236385-82c9-4a2b-9ee7-f274e695c82c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:03.942176 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5d236385-82c9-4a2b-9ee7-f274e695c82c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:04.129037 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5d236385-82c9-4a2b-9ee7-f274e695c82c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:04.137210 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5d236385-82c9-4a2b-9ee7-f274e695c82c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1507 microversion: 2.1 time: 0.210050 Sep 16 08:11:04.137795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 396/750] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:03 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1507 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:04.346560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-5a8a0331-0f5c-4077-983b-6e403872a821 req-c5f94e00-8624-4750-9fcf-7e9faaae68e8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "d6ed2e44-f810-44fb-96f8-50847e08026e", "name": "network-vif-deleted", "tag": "c9911fe4-6d13-4e4b-9a6e-7699e12bfdc4"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:04.357565 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=2,nova_api:DELETE=2,nova_api:INSERT=4 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:04.360353 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-5a8a0331-0f5c-4077-983b-6e403872a821 req-c5f94e00-8624-4750-9fcf-7e9faaae68e8 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:04.361286 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-5a8a0331-0f5c-4077-983b-6e403872a821 req-c5f94e00-8624-4750-9fcf-7e9faaae68e8 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:04.361950 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-5a8a0331-0f5c-4077-983b-6e403872a821 req-c5f94e00-8624-4750-9fcf-7e9faaae68e8 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:04.377149 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-5a8a0331-0f5c-4077-983b-6e403872a821 req-c5f94e00-8624-4750-9fcf-7e9faaae68e8 service nova] Creating event network-vif-deleted:c9911fe4-6d13-4e4b-9a6e-7699e12bfdc4 for instance d6ed2e44-f810-44fb-96f8-50847e08026e on hv-cinder-74014 Sep 16 08:11:04.383014 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-5a8a0331-0f5c-4077-983b-6e403872a821 req-c5f94e00-8624-4750-9fcf-7e9faaae68e8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.121217 Sep 16 08:11:04.384111 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 355/751] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:04.551224 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4e92ea91-8825-433d-b1a5-5abdf806e2d0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:04.551849 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4e92ea91-8825-433d-b1a5-5abdf806e2d0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:04.558388 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:04.564310 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4e92ea91-8825-433d-b1a5-5abdf806e2d0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:04.564310 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4e92ea91-8825-433d-b1a5-5abdf806e2d0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:04.564310 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4e92ea91-8825-433d-b1a5-5abdf806e2d0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:04.564310 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4e92ea91-8825-433d-b1a5-5abdf806e2d0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:04.564650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4e92ea91-8825-433d-b1a5-5abdf806e2d0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:04.564650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4e92ea91-8825-433d-b1a5-5abdf806e2d0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:04.630910 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2b08a3fe-d31a-4ca2-9a8e-8f39bd3f5045 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:04.632226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2b08a3fe-d31a-4ca2-9a8e-8f39bd3f5045 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:04.643300 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2b08a3fe-d31a-4ca2-9a8e-8f39bd3f5045 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:04.643818 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2b08a3fe-d31a-4ca2-9a8e-8f39bd3f5045 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:04.644286 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2b08a3fe-d31a-4ca2-9a8e-8f39bd3f5045 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:04.645124 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2b08a3fe-d31a-4ca2-9a8e-8f39bd3f5045 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:04.645590 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2b08a3fe-d31a-4ca2-9a8e-8f39bd3f5045 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:04.646023 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2b08a3fe-d31a-4ca2-9a8e-8f39bd3f5045 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:04.693236 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4e92ea91-8825-433d-b1a5-5abdf806e2d0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:04.706917 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4e92ea91-8825-433d-b1a5-5abdf806e2d0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:04.708279 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4e92ea91-8825-433d-b1a5-5abdf806e2d0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:04.709388 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4e92ea91-8825-433d-b1a5-5abdf806e2d0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1342 microversion: 2.20 time: 0.162328 Sep 16 08:11:04.710297 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 397/752] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:04 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1342 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:11:04.757668 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2b08a3fe-d31a-4ca2-9a8e-8f39bd3f5045 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:04.768234 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2b08a3fe-d31a-4ca2-9a8e-8f39bd3f5045 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1614 microversion: 2.1 time: 0.154684 Sep 16 08:11:04.772621 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 356/753] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:04 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1614 bytes in 160 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:04.888906 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-6750512a-0f54-401a-b24d-6cc1ba3932b3 req-df9559c4-06f1-4946-95e2-35ba0a6f3bb0 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea13dc92-1066-46f6-9fda-8d87d3721731", "name": "network-vif-deleted", "tag": "5b2d3958-4467-4e0e-8120-6287840453ee"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:04.905497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-6750512a-0f54-401a-b24d-6cc1ba3932b3 req-df9559c4-06f1-4946-95e2-35ba0a6f3bb0 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:04.905999 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-6750512a-0f54-401a-b24d-6cc1ba3932b3 req-df9559c4-06f1-4946-95e2-35ba0a6f3bb0 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:04.907157 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-6750512a-0f54-401a-b24d-6cc1ba3932b3 req-df9559c4-06f1-4946-95e2-35ba0a6f3bb0 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:04.931746 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-6750512a-0f54-401a-b24d-6cc1ba3932b3 req-df9559c4-06f1-4946-95e2-35ba0a6f3bb0 service nova] Creating event network-vif-deleted:5b2d3958-4467-4e0e-8120-6287840453ee for instance ea13dc92-1066-46f6-9fda-8d87d3721731 on hv-cinder-74014 Sep 16 08:11:04.939817 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-6750512a-0f54-401a-b24d-6cc1ba3932b3 req-df9559c4-06f1-4946-95e2-35ba0a6f3bb0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054911 Sep 16 08:11:04.943693 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 398/754] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 60 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:05.161590 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:05.162203 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:05.201391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:05.205072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:05.207046 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:05.214008 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:05.215409 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:05.218101 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:05.253279 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:05.253766 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:05.254206 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:05.254655 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lazy-loading 'fault' on Instance uuid d6ed2e44-f810-44fb-96f8-50847e08026e {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:11:05.298336 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:05.307730 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-22aa24bd-545d-4859-945f-4549089a5b41 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 200 len: 1311 microversion: 2.1 time: 0.150474 Sep 16 08:11:05.308358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 357/755] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:05 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 1311 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:05.740234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b75339f8-8e22-4c71-8ec9-84fc54b263b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:05.740938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b75339f8-8e22-4c71-8ec9-84fc54b263b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:05.748015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b75339f8-8e22-4c71-8ec9-84fc54b263b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:05.748508 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b75339f8-8e22-4c71-8ec9-84fc54b263b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:05.753688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b75339f8-8e22-4c71-8ec9-84fc54b263b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:05.753688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b75339f8-8e22-4c71-8ec9-84fc54b263b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:05.753688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b75339f8-8e22-4c71-8ec9-84fc54b263b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:05.753688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b75339f8-8e22-4c71-8ec9-84fc54b263b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:05.805788 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:05.807293 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:05.829886 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:05.830854 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:05.831928 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:05.832799 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:05.833829 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:05.835207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:05.874541 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:05.875392 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:05.876015 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:05.882788 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lazy-loading 'fault' on Instance uuid ea13dc92-1066-46f6-9fda-8d87d3721731 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:11:05.941441 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:05.949249 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4896a731-a1d8-4389-a474-1abc78323997 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 200 len: 1331 microversion: 2.1 time: 0.152112 Sep 16 08:11:05.949922 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 358/756] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:05 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 1331 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:06.042619 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b75339f8-8e22-4c71-8ec9-84fc54b263b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:06.054905 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b75339f8-8e22-4c71-8ec9-84fc54b263b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:06.056362 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b75339f8-8e22-4c71-8ec9-84fc54b263b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:06.057617 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b75339f8-8e22-4c71-8ec9-84fc54b263b6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1407 microversion: 2.20 time: 0.322097 Sep 16 08:11:06.058177 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 399/757] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:05 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1407 bytes in 324 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:11:06.331873 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-02406c35-3440-474f-b816-dd4745945977 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:06.332417 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-02406c35-3440-474f-b816-dd4745945977 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: d6ed2e44-f810-44fb-96f8-50847e08026e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:06.341670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-02406c35-3440-474f-b816-dd4745945977 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:06.341670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-02406c35-3440-474f-b816-dd4745945977 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:06.341670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-02406c35-3440-474f-b816-dd4745945977 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:06.341670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-02406c35-3440-474f-b816-dd4745945977 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:06.342038 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-02406c35-3440-474f-b816-dd4745945977 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:06.342038 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-02406c35-3440-474f-b816-dd4745945977 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:06.355910 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-02406c35-3440-474f-b816-dd4745945977 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] HTTP exception thrown: Instance d6ed2e44-f810-44fb-96f8-50847e08026e could not be found. Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-02406c35-3440-474f-b816-dd4745945977 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Request method failure captured: Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e HTTP/1.1 Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5GXkI7GeumBIhNBFf_vC-zlSOiV4dCShrtm4bkI4LE1i-bWnSTTdrg8lDXop79dMBvn6k727VeIZ9RUTBYYG88b4loy74GTRNMsNeOg1LluL0TmiejGYMmPZSLUag59Xa3AoJLUqBLHggHqVQT8xsY47QGvGbWk6SSJElkQSuFN5w Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: f143f731c6cc4b38ba979827cd390f77 Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:11:06.358153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:11:06.365406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f143f731c6cc4b38ba979827cd390f77", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:11:06.365406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:11:06.365406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: f143f731c6cc4b38ba979827cd390f77 Sep 16 08:11:06.365406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:11:06.365406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-ServerRescueNegativeTestJSON-481869959-project Sep 16 08:11:06.365406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:11:06.365406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:11:06.365406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: 5a85cff936184b5d94375fd103493950 Sep 16 08:11:06.365406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-ServerRescueNegativeTestJSON-481869959-project Sep 16 08:11:06.365406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:11:06.365406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance d6ed2e44-f810-44fb-96f8-50847e08026e could not be found. Sep 16 08:11:06.365406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': 'd6ed2e44-f810-44fb-96f8-50847e08026e'} Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance d6ed2e44-f810-44fb-96f8-50847e08026e could not be found. Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:11:06.366327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance d6ed2e44-f810-44fb-96f8-50847e08026e could not be found. Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance d6ed2e44-f810-44fb-96f8-50847e08026e could not be found. Sep 16 08:11:06.367842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:11:06.369199 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-02406c35-3440-474f-b816-dd4745945977 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Returning 404 to user: Instance d6ed2e44-f810-44fb-96f8-50847e08026e could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:11:06.369199 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-02406c35-3440-474f-b816-dd4745945977 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e" status: 404 len: 111 microversion: 2.1 time: 0.032033 Sep 16 08:11:06.369199 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 359/758] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:06 2022] GET /compute/v2.1/servers/d6ed2e44-f810-44fb-96f8-50847e08026e => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:11:06.369447 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-bc21f02f-1dae-4ef7-a284-2dd41863c9d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:06.369447 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-bc21f02f-1dae-4ef7-a284-2dd41863c9d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:06.375400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bc21f02f-1dae-4ef7-a284-2dd41863c9d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:06.376023 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bc21f02f-1dae-4ef7-a284-2dd41863c9d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:06.376366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bc21f02f-1dae-4ef7-a284-2dd41863c9d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:06.377065 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bc21f02f-1dae-4ef7-a284-2dd41863c9d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:06.377520 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bc21f02f-1dae-4ef7-a284-2dd41863c9d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:06.377995 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bc21f02f-1dae-4ef7-a284-2dd41863c9d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:06.404028 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-bc21f02f-1dae-4ef7-a284-2dd41863c9d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:11:06.703971 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-bc21f02f-1dae-4ef7-a284-2dd41863c9d1 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "DELETE /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 204 len: 0 microversion: 2.1 time: 0.339384 Sep 16 08:11:06.704576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 400/759] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:11:06 2022] DELETE /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 0 bytes in 341 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:11:06.712810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-08fc2677-c82e-4cc0-bc04-b9dc0c933836 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:06.713418 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-08fc2677-c82e-4cc0-bc04-b9dc0c933836 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:06.720006 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-08fc2677-c82e-4cc0-bc04-b9dc0c933836 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:06.720489 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-08fc2677-c82e-4cc0-bc04-b9dc0c933836 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:06.720921 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-08fc2677-c82e-4cc0-bc04-b9dc0c933836 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:06.721613 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-08fc2677-c82e-4cc0-bc04-b9dc0c933836 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:06.722063 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-08fc2677-c82e-4cc0-bc04-b9dc0c933836 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:06.722488 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-08fc2677-c82e-4cc0-bc04-b9dc0c933836 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:06.761197 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-624c7928-0385-488b-a92d-a69b08072831 req-de172c76-ac07-48c5-8a79-2e6b0e7a53ef service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f6b33b5-7327-4c2f-ae74-6f718e860360", "tag": "24fc5230-45b4-476e-ae08-dc736c4339d1"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:06.772268 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-624c7928-0385-488b-a92d-a69b08072831 req-de172c76-ac07-48c5-8a79-2e6b0e7a53ef service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:06.773049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-624c7928-0385-488b-a92d-a69b08072831 req-de172c76-ac07-48c5-8a79-2e6b0e7a53ef service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:06.773683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-624c7928-0385-488b-a92d-a69b08072831 req-de172c76-ac07-48c5-8a79-2e6b0e7a53ef service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:06.786790 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-624c7928-0385-488b-a92d-a69b08072831 req-de172c76-ac07-48c5-8a79-2e6b0e7a53ef service nova] Creating event network-changed:24fc5230-45b4-476e-ae08-dc736c4339d1 for instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 on hv-cinder-74014 Sep 16 08:11:06.792440 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-624c7928-0385-488b-a92d-a69b08072831 req-de172c76-ac07-48c5-8a79-2e6b0e7a53ef service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.035185 Sep 16 08:11:06.793261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 401/760] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:06 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:11:06.856926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-08fc2677-c82e-4cc0-bc04-b9dc0c933836 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:06.864636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-08fc2677-c82e-4cc0-bc04-b9dc0c933836 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.155726 Sep 16 08:11:06.865193 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 360/761] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:06 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:06.978551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b524f010-17be-463d-b799-d6929077afcb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:06.979280 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b524f010-17be-463d-b799-d6929077afcb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:06.985586 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b524f010-17be-463d-b799-d6929077afcb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:06.986075 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b524f010-17be-463d-b799-d6929077afcb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:06.986510 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b524f010-17be-463d-b799-d6929077afcb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:06.987233 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b524f010-17be-463d-b799-d6929077afcb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:06.987719 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b524f010-17be-463d-b799-d6929077afcb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:06.988142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b524f010-17be-463d-b799-d6929077afcb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:07.001229 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-b524f010-17be-463d-b799-d6929077afcb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b524f010-17be-463d-b799-d6929077afcb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 HTTP/1.1 Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:11:07.002875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:11:07.004387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:11:07.004387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:11:07.004387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:11:07.004387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:11:07.004387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:11:07.004387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:11:07.004387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:11:07.004387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:11:07.004387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:11:07.004387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:11:07.004387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:11:07.004387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': 'ea13dc92-1066-46f6-9fda-8d87d3721731'} Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:11:07.005463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:11:07.007018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:07.008634 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b524f010-17be-463d-b799-d6929077afcb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 404 to user: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:11:07.008634 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b524f010-17be-463d-b799-d6929077afcb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 404 len: 111 microversion: 2.1 time: 0.030526 Sep 16 08:11:07.008634 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 402/762] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:06 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:11:07.013704 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-90056bd5-8a4d-453f-945b-1c48210603be tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '.version_select at 0x7f9d068c35e0>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:07.080486 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-90056bd5-8a4d-453f-945b-1c48210603be tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378523967" status: 202 len: 0 microversion: 2.1 time: 0.071157 Sep 16 08:11:07.081063 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 361/763] 10.222.0.59 () {58 vars in 1221 bytes} [Fri Sep 16 08:11:07 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1378523967 => generated 0 bytes in 72 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:11:07.083886 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d4d45ceb-cb8c-40d8-8ca4-90b9d117fedd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:07.084502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d4d45ceb-cb8c-40d8-8ca4-90b9d117fedd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:07.090599 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d4d45ceb-cb8c-40d8-8ca4-90b9d117fedd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:07.091212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d4d45ceb-cb8c-40d8-8ca4-90b9d117fedd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:07.091657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d4d45ceb-cb8c-40d8-8ca4-90b9d117fedd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:07.092356 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d4d45ceb-cb8c-40d8-8ca4-90b9d117fedd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:07.092815 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d4d45ceb-cb8c-40d8-8ca4-90b9d117fedd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:07.093243 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d4d45ceb-cb8c-40d8-8ca4-90b9d117fedd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:07.226190 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d4d45ceb-cb8c-40d8-8ca4-90b9d117fedd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:07.234521 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d4d45ceb-cb8c-40d8-8ca4-90b9d117fedd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:07.236092 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d4d45ceb-cb8c-40d8-8ca4-90b9d117fedd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:07.237193 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d4d45ceb-cb8c-40d8-8ca4-90b9d117fedd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1407 microversion: 2.20 time: 0.157277 Sep 16 08:11:07.237749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 403/764] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:07 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1407 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:11:07.847622 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a952ffe5-ffe1-4151-ba96-319b31770a95 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: .version_select at 0x7f9d068f35e0>, body: {"keypair": {"name": "tempest-keypair-420039010", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBPrIfHhD57q++OoS04Rr81P+7+OwdgaB471E46QibG3Qr/J1+pDVXEcPDVubBWgA3aARgIPCBcTO6N+zrParBbU3tn1iLEG4yWKiCC+jjDYMxdgvPz5MdUxcsPsMAhSVbQ=="}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:07.864075 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-a952ffe5-ffe1-4151-ba96-319b31770a95 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for project b807736ef6c54be2b4715f32a4cfea57. Resources: {'key_pairs'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:11:07.867916 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-a952ffe5-ffe1-4151-ba96-319b31770a95 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for user ea2f6b804e164dbcb4f67926f23fdd59 and project b807736ef6c54be2b4715f32a4cfea57. Resources: {'key_pairs'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:11:07.887141 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7d1eab95-74ca-45af-8290-adea50ad599e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:07.887748 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7d1eab95-74ca-45af-8290-adea50ad599e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:07.893708 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d1eab95-74ca-45af-8290-adea50ad599e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:07.896432 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d1eab95-74ca-45af-8290-adea50ad599e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:07.896432 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d1eab95-74ca-45af-8290-adea50ad599e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:07.896432 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d1eab95-74ca-45af-8290-adea50ad599e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:07.896432 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d1eab95-74ca-45af-8290-adea50ad599e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:07.896805 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d1eab95-74ca-45af-8290-adea50ad599e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:07.945351 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a952ffe5-ffe1-4151-ba96-319b31770a95 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 385 microversion: 2.1 time: 0.102106 Sep 16 08:11:07.945960 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 362/765] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Sep 16 08:11:07 2022] POST /compute/v2.1/os-keypairs => generated 385 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:08.025145 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7d1eab95-74ca-45af-8290-adea50ad599e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:08.033589 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7d1eab95-74ca-45af-8290-adea50ad599e tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.150220 Sep 16 08:11:08.037857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 404/766] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:07 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:11:08.262515 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-37357633-d98d-4d59-bb3b-1749a01323dd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:08.263636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-37357633-d98d-4d59-bb3b-1749a01323dd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:08.269727 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-37357633-d98d-4d59-bb3b-1749a01323dd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:08.270209 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-37357633-d98d-4d59-bb3b-1749a01323dd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:08.270673 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-37357633-d98d-4d59-bb3b-1749a01323dd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:08.272826 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-37357633-d98d-4d59-bb3b-1749a01323dd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:08.272826 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-37357633-d98d-4d59-bb3b-1749a01323dd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:08.272826 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-37357633-d98d-4d59-bb3b-1749a01323dd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:08.398212 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-37357633-d98d-4d59-bb3b-1749a01323dd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:08.407471 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-37357633-d98d-4d59-bb3b-1749a01323dd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:08.411882 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-37357633-d98d-4d59-bb3b-1749a01323dd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:08.411882 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-37357633-d98d-4d59-bb3b-1749a01323dd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1407 microversion: 2.20 time: 0.152339 Sep 16 08:11:08.411882 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 363/767] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:08 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1407 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:11:08.669097 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3bcf4f12-34c5-4c81-9fef-6ebb7a94acf6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:08.669590 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3bcf4f12-34c5-4c81-9fef-6ebb7a94acf6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:08.675631 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bcf4f12-34c5-4c81-9fef-6ebb7a94acf6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:08.676099 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bcf4f12-34c5-4c81-9fef-6ebb7a94acf6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:08.676532 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bcf4f12-34c5-4c81-9fef-6ebb7a94acf6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:08.677216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bcf4f12-34c5-4c81-9fef-6ebb7a94acf6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:08.677670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bcf4f12-34c5-4c81-9fef-6ebb7a94acf6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:08.678094 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bcf4f12-34c5-4c81-9fef-6ebb7a94acf6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:08.703370 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3bcf4f12-34c5-4c81-9fef-6ebb7a94acf6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:11:08.917647 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:08.953795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3bcf4f12-34c5-4c81-9fef-6ebb7a94acf6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 204 len: 0 microversion: 2.1 time: 0.288239 Sep 16 08:11:08.954459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 405/768] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:11:08 2022] DELETE /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 0 bytes in 290 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:11:08.962512 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b831b1f1-8835-406b-993c-6cfe30ee6600 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:08.963263 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b831b1f1-8835-406b-993c-6cfe30ee6600 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:08.965217 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:08.970592 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b831b1f1-8835-406b-993c-6cfe30ee6600 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:08.971098 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b831b1f1-8835-406b-993c-6cfe30ee6600 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:08.971539 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b831b1f1-8835-406b-993c-6cfe30ee6600 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:08.972237 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b831b1f1-8835-406b-993c-6cfe30ee6600 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:08.972700 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b831b1f1-8835-406b-993c-6cfe30ee6600 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:08.973135 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b831b1f1-8835-406b-993c-6cfe30ee6600 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:09.057557 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0997239a-472d-4d8a-990c-a0753c18a61c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:09.058288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0997239a-472d-4d8a-990c-a0753c18a61c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:09.065837 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0997239a-472d-4d8a-990c-a0753c18a61c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:09.066405 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0997239a-472d-4d8a-990c-a0753c18a61c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:09.066858 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0997239a-472d-4d8a-990c-a0753c18a61c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:09.067713 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0997239a-472d-4d8a-990c-a0753c18a61c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:09.068179 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0997239a-472d-4d8a-990c-a0753c18a61c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:09.068644 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0997239a-472d-4d8a-990c-a0753c18a61c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:09.110929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b831b1f1-8835-406b-993c-6cfe30ee6600 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:09.119100 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b831b1f1-8835-406b-993c-6cfe30ee6600 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1576 microversion: 2.1 time: 0.160325 Sep 16 08:11:09.119673 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 364/769] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:08 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1576 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:09.309316 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0997239a-472d-4d8a-990c-a0753c18a61c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:09.317761 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0997239a-472d-4d8a-990c-a0753c18a61c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.264307 Sep 16 08:11:09.318310 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 406/770] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:09 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 266 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:11:09.442055 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ed21f040-8184-4bea-b754-aea8500de8ac tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:09.442671 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ed21f040-8184-4bea-b754-aea8500de8ac tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:09.449022 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ed21f040-8184-4bea-b754-aea8500de8ac tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:09.449514 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ed21f040-8184-4bea-b754-aea8500de8ac tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:09.449957 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ed21f040-8184-4bea-b754-aea8500de8ac tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:09.450725 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ed21f040-8184-4bea-b754-aea8500de8ac tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:09.451189 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ed21f040-8184-4bea-b754-aea8500de8ac tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:09.451624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ed21f040-8184-4bea-b754-aea8500de8ac tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:09.468038 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:09.586157 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ed21f040-8184-4bea-b754-aea8500de8ac tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:09.594998 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ed21f040-8184-4bea-b754-aea8500de8ac tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:09.596542 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ed21f040-8184-4bea-b754-aea8500de8ac tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:09.597744 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ed21f040-8184-4bea-b754-aea8500de8ac tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1407 microversion: 2.20 time: 0.159780 Sep 16 08:11:09.598384 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 365/771] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:09 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:11:10.143395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3aa0cfa5-af73-4d17-9b5d-61a45d6ff54f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:10.144015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3aa0cfa5-af73-4d17-9b5d-61a45d6ff54f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:10.150526 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3aa0cfa5-af73-4d17-9b5d-61a45d6ff54f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:10.151049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3aa0cfa5-af73-4d17-9b5d-61a45d6ff54f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:10.151562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3aa0cfa5-af73-4d17-9b5d-61a45d6ff54f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:10.152255 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3aa0cfa5-af73-4d17-9b5d-61a45d6ff54f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:10.152713 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3aa0cfa5-af73-4d17-9b5d-61a45d6ff54f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:10.153220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3aa0cfa5-af73-4d17-9b5d-61a45d6ff54f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:10.314496 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3aa0cfa5-af73-4d17-9b5d-61a45d6ff54f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:10.322283 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3aa0cfa5-af73-4d17-9b5d-61a45d6ff54f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1576 microversion: 2.1 time: 0.182902 Sep 16 08:11:10.322886 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 407/772] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:10 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1576 bytes in 185 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:10.341566 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1959cc24-141e-4093-b828-ef280ab5d24c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:10.342187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1959cc24-141e-4093-b828-ef280ab5d24c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:10.349538 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1959cc24-141e-4093-b828-ef280ab5d24c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:10.350101 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1959cc24-141e-4093-b828-ef280ab5d24c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:10.350643 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1959cc24-141e-4093-b828-ef280ab5d24c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:10.351408 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1959cc24-141e-4093-b828-ef280ab5d24c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:10.351893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1959cc24-141e-4093-b828-ef280ab5d24c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:10.352333 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1959cc24-141e-4093-b828-ef280ab5d24c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:10.484930 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1959cc24-141e-4093-b828-ef280ab5d24c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:10.492878 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1959cc24-141e-4093-b828-ef280ab5d24c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1521 microversion: 2.1 time: 0.155217 Sep 16 08:11:10.493444 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 366/773] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:10 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1521 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:10.538784 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-AttachVolumeNegativeTest-server-803710695", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "adminPass": "***", "networks": [{"uuid": "08ca5f04-b5f0-4538-b476-9e48665ae12b"}], "security_groups": [{"name": "tempest-securitygroup--631851045"}], "key_name": "tempest-keypair-420039010", "user_data": "}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:10.623735 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-42bf5953-0857-4d2a-8337-b774a131e312 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:10.624340 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-42bf5953-0857-4d2a-8337-b774a131e312 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:10.630331 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-42bf5953-0857-4d2a-8337-b774a131e312 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:10.630879 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-42bf5953-0857-4d2a-8337-b774a131e312 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:10.631294 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-42bf5953-0857-4d2a-8337-b774a131e312 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:10.631991 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-42bf5953-0857-4d2a-8337-b774a131e312 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:10.632438 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-42bf5953-0857-4d2a-8337-b774a131e312 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:10.632897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-42bf5953-0857-4d2a-8337-b774a131e312 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:10.643149 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.network.neutron [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] validate_networks() for [('08ca5f04-b5f0-4538-b476-9e48665ae12b', None, None, None, None, None)] {{(pid=121046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:11:10.770996 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-42bf5953-0857-4d2a-8337-b774a131e312 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:10.779798 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-42bf5953-0857-4d2a-8337-b774a131e312 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:10.781375 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-42bf5953-0857-4d2a-8337-b774a131e312 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:10.782628 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-42bf5953-0857-4d2a-8337-b774a131e312 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1407 microversion: 2.20 time: 0.163558 Sep 16 08:11:10.783280 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 367/774] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:10 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1407 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:11:11.209366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Flavor limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:11:11.210021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Image limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:11:11.210716 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Flavor pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:11:11.211126 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Image pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:11:11.211718 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:11:11.222481 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:11.223037 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:11.223471 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:11.224188 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:11.224639 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:11.225061 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:11.242745 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for project b807736ef6c54be2b4715f32a4cfea57. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:11:11.247064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Getting quotas for user ea2f6b804e164dbcb4f67926f23fdd59 and project b807736ef6c54be2b4715f32a4cfea57. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:11:11.258897 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Going to run 1 instances... {{(pid=121046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:11:11.261207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:11:11.345842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b8e1620b-a865-4545-b18a-337f3437136d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:11.346467 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b8e1620b-a865-4545-b18a-337f3437136d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:11.353160 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8e1620b-a865-4545-b18a-337f3437136d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:11.353596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8e1620b-a865-4545-b18a-337f3437136d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:11.354044 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8e1620b-a865-4545-b18a-337f3437136d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:11.354774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8e1620b-a865-4545-b18a-337f3437136d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:11.355966 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8e1620b-a865-4545-b18a-337f3437136d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:11.356493 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8e1620b-a865-4545-b18a-337f3437136d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:11.415738 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-49d37766-225c-4b5b-a281-c89c319fe7ac tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 401 microversion: 2.1 time: 0.881328 Sep 16 08:11:11.416802 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 408/775] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:11:10 2022] POST /compute/v2.1/servers => generated 401 bytes in 883 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:11:11.428488 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-bf74403e-94a3-486e-82e9-553205917c93 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:11.429719 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-bf74403e-94a3-486e-82e9-553205917c93 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:11.550885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-bf74403e-94a3-486e-82e9-553205917c93 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:11.558460 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-bf74403e-94a3-486e-82e9-553205917c93 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1240 microversion: 2.1 time: 0.134374 Sep 16 08:11:11.571373 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 409/776] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:11 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1240 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:11.581140 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-191d4782-58b7-4dd8-9055-671cd6e4fbcf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:11.582110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-191d4782-58b7-4dd8-9055-671cd6e4fbcf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:11.591108 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-191d4782-58b7-4dd8-9055-671cd6e4fbcf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:11.591613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-191d4782-58b7-4dd8-9055-671cd6e4fbcf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:11.592377 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-191d4782-58b7-4dd8-9055-671cd6e4fbcf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:11.593508 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-191d4782-58b7-4dd8-9055-671cd6e4fbcf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:11.594259 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-191d4782-58b7-4dd8-9055-671cd6e4fbcf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:11.595034 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-191d4782-58b7-4dd8-9055-671cd6e4fbcf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:11.680925 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-191d4782-58b7-4dd8-9055-671cd6e4fbcf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:11.690081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-191d4782-58b7-4dd8-9055-671cd6e4fbcf tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1479 microversion: 2.1 time: 0.117387 Sep 16 08:11:11.690963 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 410/777] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:11 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1479 bytes in 119 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:11.696964 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b8e1620b-a865-4545-b18a-337f3437136d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:11.712507 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b8e1620b-a865-4545-b18a-337f3437136d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1576 microversion: 2.1 time: 0.370929 Sep 16 08:11:11.713751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 368/778] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:11 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1576 bytes in 373 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:11:11.714748 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-884be295-39db-4a54-86a6-46a79d884caf req-fead9233-e8bd-473b-be82-bff981f666d1 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "c6e123e7-4239-4c3a-8e4b-363f1a2bc058", "name": "network-vif-deleted", "tag": "27b13be5-f0af-474b-bcb2-8afc268cf10e"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:11.732846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-884be295-39db-4a54-86a6-46a79d884caf req-fead9233-e8bd-473b-be82-bff981f666d1 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:11.733338 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-884be295-39db-4a54-86a6-46a79d884caf req-fead9233-e8bd-473b-be82-bff981f666d1 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:11.733782 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-884be295-39db-4a54-86a6-46a79d884caf req-fead9233-e8bd-473b-be82-bff981f666d1 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:11.753846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-884be295-39db-4a54-86a6-46a79d884caf req-fead9233-e8bd-473b-be82-bff981f666d1 service nova] Creating event network-vif-deleted:27b13be5-f0af-474b-bcb2-8afc268cf10e for instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 on hv-cinder-74014 Sep 16 08:11:11.758870 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-884be295-39db-4a54-86a6-46a79d884caf req-fead9233-e8bd-473b-be82-bff981f666d1 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.054714 Sep 16 08:11:11.759805 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 411/779] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:11 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 68 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:11.811933 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4ceb0417-d7bc-4c6b-b649-afd63974d8bb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:11.812810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4ceb0417-d7bc-4c6b-b649-afd63974d8bb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:11.819434 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4ceb0417-d7bc-4c6b-b649-afd63974d8bb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:11.819937 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4ceb0417-d7bc-4c6b-b649-afd63974d8bb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:11.820375 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4ceb0417-d7bc-4c6b-b649-afd63974d8bb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:11.822723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4ceb0417-d7bc-4c6b-b649-afd63974d8bb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:11.822723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4ceb0417-d7bc-4c6b-b649-afd63974d8bb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:11.822723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4ceb0417-d7bc-4c6b-b649-afd63974d8bb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:12.077053 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-4ceb0417-d7bc-4c6b-b649-afd63974d8bb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:12.085613 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-4ceb0417-d7bc-4c6b-b649-afd63974d8bb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:12.087379 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-4ceb0417-d7bc-4c6b-b649-afd63974d8bb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:12.088533 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4ceb0417-d7bc-4c6b-b649-afd63974d8bb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1407 microversion: 2.20 time: 0.284428 Sep 16 08:11:12.089129 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 369/780] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:11 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1407 bytes in 286 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:11:12.585987 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0654222a-528a-4ef8-af60-f47a34efb5eb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:12.586795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0654222a-528a-4ef8-af60-f47a34efb5eb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:12.595363 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0654222a-528a-4ef8-af60-f47a34efb5eb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:12.595871 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0654222a-528a-4ef8-af60-f47a34efb5eb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:12.596322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0654222a-528a-4ef8-af60-f47a34efb5eb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:12.597057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0654222a-528a-4ef8-af60-f47a34efb5eb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:12.597669 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0654222a-528a-4ef8-af60-f47a34efb5eb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:12.598109 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0654222a-528a-4ef8-af60-f47a34efb5eb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:12.602523 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=2,nova_cell1:INSERT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:12.661262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0654222a-528a-4ef8-af60-f47a34efb5eb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:12.671474 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0654222a-528a-4ef8-af60-f47a34efb5eb tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1244 microversion: 2.1 time: 0.089731 Sep 16 08:11:12.672308 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 412/781] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:12 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1244 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:12.718289 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:12.719130 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:12.725617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:12.726369 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:12.726854 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:12.727621 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:12.728256 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:12.728691 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:12.745134 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d5f387f9-e2d9-4444-a861-3189f59701e2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:12.745762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d5f387f9-e2d9-4444-a861-3189f59701e2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:12.753117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5f387f9-e2d9-4444-a861-3189f59701e2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:12.753846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5f387f9-e2d9-4444-a861-3189f59701e2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:12.754451 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5f387f9-e2d9-4444-a861-3189f59701e2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:12.755428 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5f387f9-e2d9-4444-a861-3189f59701e2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:12.773627 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5f387f9-e2d9-4444-a861-3189f59701e2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:12.773627 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5f387f9-e2d9-4444-a861-3189f59701e2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:12.773858 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:12.773858 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:12.773858 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:12.773858 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lazy-loading 'fault' on Instance uuid c6e123e7-4239-4c3a-8e4b-363f1a2bc058 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:11:12.819340 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '5a85cff936184b5d94375fd103493950', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'f143f731c6cc4b38ba979827cd390f77', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:12.836937 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a90f26ef-4d62-489b-82e0-a597b8686d1c tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 200 len: 1312 microversion: 2.1 time: 0.123253 Sep 16 08:11:12.850952 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d5f387f9-e2d9-4444-a861-3189f59701e2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:12.851083 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 370/782] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:12 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 1312 bytes in 130 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:12.857900 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d5f387f9-e2d9-4444-a861-3189f59701e2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1508 microversion: 2.1 time: 0.123862 Sep 16 08:11:12.858489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 413/783] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:12 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1508 bytes in 125 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:11:13.113501 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fed41b33-6e61-4f80-bd53-213226f36419 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:13.114138 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-fed41b33-6e61-4f80-bd53-213226f36419 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:13.120334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fed41b33-6e61-4f80-bd53-213226f36419 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:13.120855 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fed41b33-6e61-4f80-bd53-213226f36419 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:13.121301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fed41b33-6e61-4f80-bd53-213226f36419 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:13.122526 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fed41b33-6e61-4f80-bd53-213226f36419 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:13.123117 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fed41b33-6e61-4f80-bd53-213226f36419 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:13.123554 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fed41b33-6e61-4f80-bd53-213226f36419 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:13.255111 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fed41b33-6e61-4f80-bd53-213226f36419 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:13.265982 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fed41b33-6e61-4f80-bd53-213226f36419 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:13.267601 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fed41b33-6e61-4f80-bd53-213226f36419 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:13.268782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-fed41b33-6e61-4f80-bd53-213226f36419 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1407 microversion: 2.20 time: 0.159474 Sep 16 08:11:13.269347 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 371/784] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:13 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1407 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:11:13.694447 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5cd50cb3-9fc0-4dcb-9af7-a87148188c5d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:13.697712 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5cd50cb3-9fc0-4dcb-9af7-a87148188c5d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:13.702085 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5cd50cb3-9fc0-4dcb-9af7-a87148188c5d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:13.702593 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5cd50cb3-9fc0-4dcb-9af7-a87148188c5d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:13.703071 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5cd50cb3-9fc0-4dcb-9af7-a87148188c5d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:13.703834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5cd50cb3-9fc0-4dcb-9af7-a87148188c5d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:13.704296 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5cd50cb3-9fc0-4dcb-9af7-a87148188c5d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:13.704895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5cd50cb3-9fc0-4dcb-9af7-a87148188c5d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:13.777475 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-f2f81470-abe0-45df-9be0-3c28fa4e66db req-a7c835d5-4ae2-49cb-8594-b0b17ce05738 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ea19d9a7-5838-4755-b520-7f6fa0ebde3d", "name": "network-vif-deleted", "tag": "7d637a8f-0225-4aa9-bc24-95e5a1a77fff"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:13.787781 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-f2f81470-abe0-45df-9be0-3c28fa4e66db req-a7c835d5-4ae2-49cb-8594-b0b17ce05738 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:13.788267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-f2f81470-abe0-45df-9be0-3c28fa4e66db req-a7c835d5-4ae2-49cb-8594-b0b17ce05738 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:13.788699 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-f2f81470-abe0-45df-9be0-3c28fa4e66db req-a7c835d5-4ae2-49cb-8594-b0b17ce05738 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:13.798786 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5cd50cb3-9fc0-4dcb-9af7-a87148188c5d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:13.800597 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-f2f81470-abe0-45df-9be0-3c28fa4e66db req-a7c835d5-4ae2-49cb-8594-b0b17ce05738 service nova] Creating event network-vif-deleted:7d637a8f-0225-4aa9-bc24-95e5a1a77fff for instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d on hv-cinder-74014 Sep 16 08:11:13.805640 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-f2f81470-abe0-45df-9be0-3c28fa4e66db req-a7c835d5-4ae2-49cb-8594-b0b17ce05738 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031971 Sep 16 08:11:13.806227 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 372/785] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:11:13.806622 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5cd50cb3-9fc0-4dcb-9af7-a87148188c5d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1292 microversion: 2.1 time: 0.116181 Sep 16 08:11:13.807226 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 414/786] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:13 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1292 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:13.863773 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9fbf4d5e-c515-4c44-a07c-81d1ad8f75a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:13.864471 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9fbf4d5e-c515-4c44-a07c-81d1ad8f75a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] [instance: c6e123e7-4239-4c3a-8e4b-363f1a2bc058] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:13.870703 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9fbf4d5e-c515-4c44-a07c-81d1ad8f75a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:13.871359 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9fbf4d5e-c515-4c44-a07c-81d1ad8f75a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:13.871753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9fbf4d5e-c515-4c44-a07c-81d1ad8f75a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:13.872463 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9fbf4d5e-c515-4c44-a07c-81d1ad8f75a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:13.872927 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9fbf4d5e-c515-4c44-a07c-81d1ad8f75a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:13.873361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9fbf4d5e-c515-4c44-a07c-81d1ad8f75a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:13.881323 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:13.883474 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:13.888173 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:13.888662 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:13.889110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:13.889645 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-9fbf4d5e-c515-4c44-a07c-81d1ad8f75a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] HTTP exception thrown: Instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 could not be found. Sep 16 08:11:13.889783 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:13.890245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:13.890672 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9fbf4d5e-c515-4c44-a07c-81d1ad8f75a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Request method failure captured: Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 HTTP/1.1 Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5GXkI7GeumBIhNBFf_vC-zlSOiV4dCShrtm4bkI4LE1i-bWnSTTdrg8lDXop79dMBvn6k727VeIZ9RUTBYYG88b4loy74GTRNMsNeOg1LluL0TmiejGYMmPZSLUag59Xa3AoJLUqBLHggHqVQT8xsY47QGvGbWk6SSJElkQSuFN5w Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: f143f731c6cc4b38ba979827cd390f77 Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:11:13.891682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:11:13.893144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_f143f731c6cc4b38ba979827cd390f77", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/f143f731c6cc4b38ba979827cd390f77"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:11:13.893144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:11:13.893144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: f143f731c6cc4b38ba979827cd390f77 Sep 16 08:11:13.893144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-ServerRescueNegativeTestJSON-481869959 Sep 16 08:11:13.893144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-ServerRescueNegativeTestJSON-481869959-project Sep 16 08:11:13.893144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:11:13.893144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:11:13.893144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: 5a85cff936184b5d94375fd103493950 Sep 16 08:11:13.893144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-ServerRescueNegativeTestJSON-481869959-project Sep 16 08:11:13.893144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:11:13.893144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 could not be found. Sep 16 08:11:13.893144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': 'c6e123e7-4239-4c3a-8e4b-363f1a2bc058'} Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 could not be found. Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:11:13.894036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 could not be found. Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 could not be found. Sep 16 08:11:13.895348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:11:13.896502 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9fbf4d5e-c515-4c44-a07c-81d1ad8f75a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] Returning 404 to user: Instance c6e123e7-4239-4c3a-8e4b-363f1a2bc058 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:11:13.896502 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9fbf4d5e-c515-4c44-a07c-81d1ad8f75a4 tempest-ServerRescueNegativeTestJSON-481869959 tempest-ServerRescueNegativeTestJSON-481869959-project] 10.222.0.59 "GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058" status: 404 len: 111 microversion: 2.1 time: 0.034285 Sep 16 08:11:13.896502 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 373/787] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:13 2022] GET /compute/v2.1/servers/c6e123e7-4239-4c3a-8e4b-363f1a2bc058 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:11:13.932566 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:13.933080 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:13.933556 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:13.934005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lazy-loading 'fault' on Instance uuid ea19d9a7-5838-4755-b520-7f6fa0ebde3d {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:11:13.976771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:13.986357 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d25c80b5-c971-4c6e-bb89-c58f8cf5be67 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1229 microversion: 2.1 time: 0.108862 Sep 16 08:11:13.986970 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 415/788] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:13 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1229 bytes in 110 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:14.294367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6851bdd3-535b-41f3-b8fd-fff6c711d2b7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:14.295803 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6851bdd3-535b-41f3-b8fd-fff6c711d2b7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:14.302714 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6851bdd3-535b-41f3-b8fd-fff6c711d2b7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:14.303415 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6851bdd3-535b-41f3-b8fd-fff6c711d2b7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:14.305166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6851bdd3-535b-41f3-b8fd-fff6c711d2b7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:14.306397 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6851bdd3-535b-41f3-b8fd-fff6c711d2b7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:14.307277 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6851bdd3-535b-41f3-b8fd-fff6c711d2b7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:14.311191 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6851bdd3-535b-41f3-b8fd-fff6c711d2b7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:14.652823 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6851bdd3-535b-41f3-b8fd-fff6c711d2b7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:14.670930 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6851bdd3-535b-41f3-b8fd-fff6c711d2b7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:14.672383 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6851bdd3-535b-41f3-b8fd-fff6c711d2b7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:14.673508 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6851bdd3-535b-41f3-b8fd-fff6c711d2b7 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1407 microversion: 2.20 time: 0.384107 Sep 16 08:11:14.674423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 374/789] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:14 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1407 bytes in 385 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:11:15.015137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-30c8e47c-5ce8-4111-b10e-d3a2b5708569 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:15.015137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-30c8e47c-5ce8-4111-b10e-d3a2b5708569 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:15.015137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-30c8e47c-5ce8-4111-b10e-d3a2b5708569 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:15.015137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-30c8e47c-5ce8-4111-b10e-d3a2b5708569 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:15.016251 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-30c8e47c-5ce8-4111-b10e-d3a2b5708569 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:15.016251 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-30c8e47c-5ce8-4111-b10e-d3a2b5708569 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:15.016251 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-30c8e47c-5ce8-4111-b10e-d3a2b5708569 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:15.016251 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-30c8e47c-5ce8-4111-b10e-d3a2b5708569 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:15.016617 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-30c8e47c-5ce8-4111-b10e-d3a2b5708569 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:15.016617 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-30c8e47c-5ce8-4111-b10e-d3a2b5708569 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1310 microversion: 2.1 time: 0.088354 Sep 16 08:11:15.016617 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 416/790] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:14 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1310 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:15.016919 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:15.016919 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:15.016919 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:15.017473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:15.017625 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:15.018334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:15.018909 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:15.019746 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:15.054262 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:15.054895 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:15.055476 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:15.055938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lazy-loading 'fault' on Instance uuid ea19d9a7-5838-4755-b520-7f6fa0ebde3d {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:11:15.189678 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:15.197765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-245d801e-7d10-442f-97a3-d451ed36cec6 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 200 len: 1229 microversion: 2.1 time: 0.192391 Sep 16 08:11:15.198341 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 375/791] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:15 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 1229 bytes in 194 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:15.704809 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-bfe9b6c4-b413-4999-9335-02e35017e50b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:15.705696 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-bfe9b6c4-b413-4999-9335-02e35017e50b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:15.716838 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bfe9b6c4-b413-4999-9335-02e35017e50b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:15.725561 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bfe9b6c4-b413-4999-9335-02e35017e50b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:15.725561 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bfe9b6c4-b413-4999-9335-02e35017e50b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:15.725561 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bfe9b6c4-b413-4999-9335-02e35017e50b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:15.725561 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bfe9b6c4-b413-4999-9335-02e35017e50b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:15.727183 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bfe9b6c4-b413-4999-9335-02e35017e50b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:15.767904 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-3c2e43eb-7d65-49f2-8f86-d889f1f11267 req-ebe03bdf-9432-437b-8c14-307693d31bd8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6b33b5-7327-4c2f-ae74-6f718e860360", "name": "network-vif-plugged", "status": "completed", "tag": "24fc5230-45b4-476e-ae08-dc736c4339d1"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:15.785189 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-3c2e43eb-7d65-49f2-8f86-d889f1f11267 req-ebe03bdf-9432-437b-8c14-307693d31bd8 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:15.785189 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-3c2e43eb-7d65-49f2-8f86-d889f1f11267 req-ebe03bdf-9432-437b-8c14-307693d31bd8 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:15.785189 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-3c2e43eb-7d65-49f2-8f86-d889f1f11267 req-ebe03bdf-9432-437b-8c14-307693d31bd8 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:15.796302 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-3c2e43eb-7d65-49f2-8f86-d889f1f11267 req-ebe03bdf-9432-437b-8c14-307693d31bd8 service nova] Creating event network-vif-plugged:24fc5230-45b4-476e-ae08-dc736c4339d1 for instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 on hv-cinder-74014 Sep 16 08:11:15.801929 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-3c2e43eb-7d65-49f2-8f86-d889f1f11267 req-ebe03bdf-9432-437b-8c14-307693d31bd8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.109241 Sep 16 08:11:15.803172 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 417/792] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:15 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:15.940787 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f3594491-4e97-43f1-9963-469a182c1376 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:15.941457 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f3594491-4e97-43f1-9963-469a182c1376 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:15.947834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f3594491-4e97-43f1-9963-469a182c1376 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:15.948331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f3594491-4e97-43f1-9963-469a182c1376 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:15.948798 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f3594491-4e97-43f1-9963-469a182c1376 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:15.949557 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f3594491-4e97-43f1-9963-469a182c1376 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:15.950017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f3594491-4e97-43f1-9963-469a182c1376 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:15.951021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f3594491-4e97-43f1-9963-469a182c1376 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:16.018583 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f3594491-4e97-43f1-9963-469a182c1376 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:16.027244 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f3594491-4e97-43f1-9963-469a182c1376 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1298 microversion: 2.1 time: 0.091269 Sep 16 08:11:16.029179 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 418/793] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:15 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1298 bytes in 93 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:11:16.052719 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-bfe9b6c4-b413-4999-9335-02e35017e50b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:16.062094 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-bfe9b6c4-b413-4999-9335-02e35017e50b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:16.063701 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-bfe9b6c4-b413-4999-9335-02e35017e50b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:16.064909 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-bfe9b6c4-b413-4999-9335-02e35017e50b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1407 microversion: 2.20 time: 0.368361 Sep 16 08:11:16.065568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 376/794] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:15 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1407 bytes in 370 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:11:16.220591 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-95532c2d-710e-4011-b540-1db6e4bb8246 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:16.221384 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-95532c2d-710e-4011-b540-1db6e4bb8246 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:16.227763 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-95532c2d-710e-4011-b540-1db6e4bb8246 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:16.228289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-95532c2d-710e-4011-b540-1db6e4bb8246 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:16.228933 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-95532c2d-710e-4011-b540-1db6e4bb8246 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:16.229655 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-95532c2d-710e-4011-b540-1db6e4bb8246 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:16.230120 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-95532c2d-710e-4011-b540-1db6e4bb8246 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:16.230552 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-95532c2d-710e-4011-b540-1db6e4bb8246 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:16.245884 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-95532c2d-710e-4011-b540-1db6e4bb8246 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] HTTP exception thrown: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-95532c2d-710e-4011-b540-1db6e4bb8246 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Request method failure captured: Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d HTTP/1.1 Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC7icc78RDqf1g0pn-txuagC1GTaL1aKZB7vktx-XG4uVN4TFTZJJbhJ2s0ZnCqlJ18WLQDJHcKLkofsjUo5J5n9INqsVZBriLM7wME2rxyErmH0YMVll4Vky1wePEf1bJcfZ1cWuQTQd2pVWc1fc3zBXCImrYy9GI2nQgVL9TPhptA Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 794ad972bfa844538f6f71d62e7bd163 Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-TestVolumeBootPattern-541351610 Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:11:16.248142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:11:16.249572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_794ad972bfa844538f6f71d62e7bd163", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:11:16.249572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-TestVolumeBootPattern-541351610 Sep 16 08:11:16.249572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 794ad972bfa844538f6f71d62e7bd163 Sep 16 08:11:16.249572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-TestVolumeBootPattern-541351610 Sep 16 08:11:16.249572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-TestVolumeBootPattern-541351610-project Sep 16 08:11:16.249572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:11:16.249572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:11:16.249572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: afbb1d9c9bb34fbd8bfc78710c86d1f5 Sep 16 08:11:16.249572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-TestVolumeBootPattern-541351610-project Sep 16 08:11:16.249572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:11:16.249572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:11:16.249572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': 'ea19d9a7-5838-4755-b520-7f6fa0ebde3d'} Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:11:16.250387 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:11:16.251816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:16.252963 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-95532c2d-710e-4011-b540-1db6e4bb8246 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Returning 404 to user: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:11:16.252963 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-95532c2d-710e-4011-b540-1db6e4bb8246 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 404 len: 111 microversion: 2.1 time: 0.033580 Sep 16 08:11:16.252963 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 419/795] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:16 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:11:16.363958 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-138008389", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1882303610", "security_groups": [{"name": "tempest-secgroup-smoke-2047951653"}], "block_device_mapping_v2": [{"uuid": "0759dfca-a75d-482d-989d-897b8593a212", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3183744-0e74-401e-ac7d-6d88c22643af"}]}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:16.550151 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.network.neutron [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] validate_networks() for [('c3183744-0e74-401e-ac7d-6d88c22643af', None, None, None, None, None)] {{(pid=121047) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:11:17.051663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f28d2880-5926-4a24-846e-77ea704c9a4d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:17.053193 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f28d2880-5926-4a24-846e-77ea704c9a4d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:17.062143 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f28d2880-5926-4a24-846e-77ea704c9a4d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:17.063665 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f28d2880-5926-4a24-846e-77ea704c9a4d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:17.071094 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f28d2880-5926-4a24-846e-77ea704c9a4d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:17.073459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f28d2880-5926-4a24-846e-77ea704c9a4d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:17.074668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f28d2880-5926-4a24-846e-77ea704c9a4d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:17.075610 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f28d2880-5926-4a24-846e-77ea704c9a4d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:17.205851 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Flavor limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:11:17.207029 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Image limits 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:11:17.207514 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Flavor pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:11:17.207932 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Image pref 0:0:0 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:11:17.208451 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.virt.hardware [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121047) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:11:17.214917 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=15 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:17.219336 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:17.220024 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:17.220462 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:17.221219 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:17.221671 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:17.222099 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:17.238914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Getting quotas for project 794ad972bfa844538f6f71d62e7bd163. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:11:17.246003 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Getting quotas for user afbb1d9c9bb34fbd8bfc78710c86d1f5 and project 794ad972bfa844538f6f71d62e7bd163. Resources: {'cores', 'ram', 'instances'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:11:17.263102 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f28d2880-5926-4a24-846e-77ea704c9a4d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:17.270887 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f28d2880-5926-4a24-846e-77ea704c9a4d tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1365 microversion: 2.1 time: 0.223342 Sep 16 08:11:17.276292 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 420/796] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:17 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1365 bytes in 225 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:17.276292 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7d379321-115c-45ed-9995-e8570a18e0e5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:17.276632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7d379321-115c-45ed-9995-e8570a18e0e5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:17.283328 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d379321-115c-45ed-9995-e8570a18e0e5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:17.283812 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d379321-115c-45ed-9995-e8570a18e0e5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:17.284249 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d379321-115c-45ed-9995-e8570a18e0e5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:17.284937 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d379321-115c-45ed-9995-e8570a18e0e5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:17.285398 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d379321-115c-45ed-9995-e8570a18e0e5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:17.285827 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7d379321-115c-45ed-9995-e8570a18e0e5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:17.305219 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Going to run 1 instances... {{(pid=121047) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:11:17.307399 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='0759dfca-a75d-482d-989d-897b8593a212',volume_size=None,volume_type=None)] {{(pid=121047) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:11:17.596740 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7d379321-115c-45ed-9995-e8570a18e0e5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:17.619775 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7d379321-115c-45ed-9995-e8570a18e0e5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:17.621192 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7d379321-115c-45ed-9995-e8570a18e0e5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:17.625360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7d379321-115c-45ed-9995-e8570a18e0e5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1407 microversion: 2.20 time: 0.352781 Sep 16 08:11:17.626120 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 421/797] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:17 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1407 bytes in 354 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:11:17.745648 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7a3dd5d0-a4d9-4197-a2cd-1e12cb33fbb7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.383660 Sep 16 08:11:17.745648 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 377/798] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:11:16 2022] POST /compute/v2.1/servers => generated 406 bytes in 1385 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 08:11:17.756324 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-fe2127ef-f0d7-4c26-aac6-58aba1194a3a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:17.757205 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-fe2127ef-f0d7-4c26-aac6-58aba1194a3a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:17.814024 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-a9af8c32-7f5e-4c42-a64e-aeb1969bbd3d req-df0ea5e9-3025-47de-8c38-00d03f26b331 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f515fbb-b67a-402f-8768-d42e46423db1", "tag": "0952c557-1b1e-4f0b-84db-689b34cad324"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:17.831055 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-a9af8c32-7f5e-4c42-a64e-aeb1969bbd3d req-df0ea5e9-3025-47de-8c38-00d03f26b331 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:17.831943 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-a9af8c32-7f5e-4c42-a64e-aeb1969bbd3d req-df0ea5e9-3025-47de-8c38-00d03f26b331 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:17.832619 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-a9af8c32-7f5e-4c42-a64e-aeb1969bbd3d req-df0ea5e9-3025-47de-8c38-00d03f26b331 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:17.843034 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-fe2127ef-f0d7-4c26-aac6-58aba1194a3a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:17.852699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-fe2127ef-f0d7-4c26-aac6-58aba1194a3a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1094 microversion: 2.1 time: 0.099346 Sep 16 08:11:17.854924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 422/799] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:17 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1094 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:11:17.877424 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-a9af8c32-7f5e-4c42-a64e-aeb1969bbd3d req-df0ea5e9-3025-47de-8c38-00d03f26b331 service nova] Creating event network-changed:0952c557-1b1e-4f0b-84db-689b34cad324 for instance 6f515fbb-b67a-402f-8768-d42e46423db1 on hv-cinder-74014 Sep 16 08:11:17.892518 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-a9af8c32-7f5e-4c42-a64e-aeb1969bbd3d req-df0ea5e9-3025-47de-8c38-00d03f26b331 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.084199 Sep 16 08:11:17.893147 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 378/800] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:17 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:18.294448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b6fbc63e-5efb-4eaf-a10c-d29d0fb45454 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:18.296010 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b6fbc63e-5efb-4eaf-a10c-d29d0fb45454 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:18.308158 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b6fbc63e-5efb-4eaf-a10c-d29d0fb45454 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:18.308974 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b6fbc63e-5efb-4eaf-a10c-d29d0fb45454 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:18.309463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b6fbc63e-5efb-4eaf-a10c-d29d0fb45454 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:18.311855 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b6fbc63e-5efb-4eaf-a10c-d29d0fb45454 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:18.312338 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b6fbc63e-5efb-4eaf-a10c-d29d0fb45454 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:18.312782 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b6fbc63e-5efb-4eaf-a10c-d29d0fb45454 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:18.563209 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b6fbc63e-5efb-4eaf-a10c-d29d0fb45454 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:18.568572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b6fbc63e-5efb-4eaf-a10c-d29d0fb45454 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1365 microversion: 2.1 time: 0.278630 Sep 16 08:11:18.579502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 423/801] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:18 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1365 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:18.654787 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-89dc87d9-4e01-4c57-89eb-beb06655ae53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:18.655495 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-89dc87d9-4e01-4c57-89eb-beb06655ae53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:18.661888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-89dc87d9-4e01-4c57-89eb-beb06655ae53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:18.662379 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-89dc87d9-4e01-4c57-89eb-beb06655ae53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:18.663085 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-89dc87d9-4e01-4c57-89eb-beb06655ae53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:18.663549 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-89dc87d9-4e01-4c57-89eb-beb06655ae53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:18.664080 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-89dc87d9-4e01-4c57-89eb-beb06655ae53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:18.664517 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-89dc87d9-4e01-4c57-89eb-beb06655ae53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:18.858385 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-89dc87d9-4e01-4c57-89eb-beb06655ae53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:18.861508 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-89dc87d9-4e01-4c57-89eb-beb06655ae53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:18.863112 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-89dc87d9-4e01-4c57-89eb-beb06655ae53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:18.864416 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-89dc87d9-4e01-4c57-89eb-beb06655ae53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1600 microversion: 2.20 time: 0.216356 Sep 16 08:11:18.865086 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 379/802] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:11:18 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1600 bytes in 218 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:11:18.877702 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-18938b52-5baa-4f04-b1f6-73ee3e36dbab tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:18.878752 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-18938b52-5baa-4f04-b1f6-73ee3e36dbab tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:18.884965 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18938b52-5baa-4f04-b1f6-73ee3e36dbab tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:18.888149 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18938b52-5baa-4f04-b1f6-73ee3e36dbab tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:18.888149 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18938b52-5baa-4f04-b1f6-73ee3e36dbab tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:18.888756 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18938b52-5baa-4f04-b1f6-73ee3e36dbab tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:18.889230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18938b52-5baa-4f04-b1f6-73ee3e36dbab tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:18.889667 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-18938b52-5baa-4f04-b1f6-73ee3e36dbab tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:18.893551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-cec0f428-83b0-4d20-9f93-c748258e92f5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:18.894056 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-cec0f428-83b0-4d20-9f93-c748258e92f5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:18.901939 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cec0f428-83b0-4d20-9f93-c748258e92f5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:18.902511 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cec0f428-83b0-4d20-9f93-c748258e92f5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:18.903054 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cec0f428-83b0-4d20-9f93-c748258e92f5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:18.904913 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cec0f428-83b0-4d20-9f93-c748258e92f5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:18.905619 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cec0f428-83b0-4d20-9f93-c748258e92f5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:18.909271 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cec0f428-83b0-4d20-9f93-c748258e92f5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:18.997757 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-18938b52-5baa-4f04-b1f6-73ee3e36dbab tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:19.001626 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-cec0f428-83b0-4d20-9f93-c748258e92f5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/os-interface" status: 200 len: 285 microversion: 2.20 time: 0.114536 Sep 16 08:11:19.002461 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 380/803] 10.222.0.59 () {60 vars in 1316 bytes} [Fri Sep 16 08:11:18 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/os-interface => generated 285 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 08:11:19.006106 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-18938b52-5baa-4f04-b1f6-73ee3e36dbab tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1144 microversion: 2.1 time: 0.132573 Sep 16 08:11:19.006850 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 424/804] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:18 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1144 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:19.593962 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-67f3dc73-6348-4624-a89c-1d75b1f72238 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:19.594789 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-67f3dc73-6348-4624-a89c-1d75b1f72238 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:19.601889 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-67f3dc73-6348-4624-a89c-1d75b1f72238 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:19.602725 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-67f3dc73-6348-4624-a89c-1d75b1f72238 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:19.603207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-67f3dc73-6348-4624-a89c-1d75b1f72238 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:19.604517 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-67f3dc73-6348-4624-a89c-1d75b1f72238 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:19.607278 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-67f3dc73-6348-4624-a89c-1d75b1f72238 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:19.607725 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-67f3dc73-6348-4624-a89c-1d75b1f72238 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:19.772123 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-67f3dc73-6348-4624-a89c-1d75b1f72238 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:19.782923 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-67f3dc73-6348-4624-a89c-1d75b1f72238 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1365 microversion: 2.1 time: 0.192480 Sep 16 08:11:19.797813 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 381/805] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:19 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1365 bytes in 210 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:20.030189 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e2237dcd-10ef-4358-ab38-ace522a5ddad tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:20.030838 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e2237dcd-10ef-4358-ab38-ace522a5ddad tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:20.038294 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e2237dcd-10ef-4358-ab38-ace522a5ddad tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:20.039067 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e2237dcd-10ef-4358-ab38-ace522a5ddad tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:20.039514 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e2237dcd-10ef-4358-ab38-ace522a5ddad tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:20.040364 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e2237dcd-10ef-4358-ab38-ace522a5ddad tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:20.040973 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e2237dcd-10ef-4358-ab38-ace522a5ddad tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:20.041701 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e2237dcd-10ef-4358-ab38-ace522a5ddad tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:20.132608 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e2237dcd-10ef-4358-ab38-ace522a5ddad tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:20.139799 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e2237dcd-10ef-4358-ab38-ace522a5ddad tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1136 microversion: 2.1 time: 0.114288 Sep 16 08:11:20.140585 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 425/806] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:20 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1136 bytes in 116 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:20.303534 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-4c72fb3c-724e-47d0-b2c2-8d69bcb5e520 req-e5eaf521-0512-4464-a5a0-7f88509f95e2 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "7f6b33b5-7327-4c2f-ae74-6f718e860360", "tag": "24fc5230-45b4-476e-ae08-dc736c4339d1"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:20.313487 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-4c72fb3c-724e-47d0-b2c2-8d69bcb5e520 req-e5eaf521-0512-4464-a5a0-7f88509f95e2 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:20.314197 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-4c72fb3c-724e-47d0-b2c2-8d69bcb5e520 req-e5eaf521-0512-4464-a5a0-7f88509f95e2 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:20.314636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-4c72fb3c-724e-47d0-b2c2-8d69bcb5e520 req-e5eaf521-0512-4464-a5a0-7f88509f95e2 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:20.328993 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-4c72fb3c-724e-47d0-b2c2-8d69bcb5e520 req-e5eaf521-0512-4464-a5a0-7f88509f95e2 service nova] Creating event network-changed:24fc5230-45b4-476e-ae08-dc736c4339d1 for instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 on hv-cinder-74014 Sep 16 08:11:20.334497 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-4c72fb3c-724e-47d0-b2c2-8d69bcb5e520 req-e5eaf521-0512-4464-a5a0-7f88509f95e2 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.034666 Sep 16 08:11:20.335729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 382/807] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:20 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 37 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:20.814440 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-292c326b-4ff3-43e3-b006-8fa336c8e348 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:20.815497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-292c326b-4ff3-43e3-b006-8fa336c8e348 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:20.828115 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-292c326b-4ff3-43e3-b006-8fa336c8e348 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:20.828857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-292c326b-4ff3-43e3-b006-8fa336c8e348 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:20.829453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-292c326b-4ff3-43e3-b006-8fa336c8e348 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:20.830354 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-292c326b-4ff3-43e3-b006-8fa336c8e348 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:20.831000 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-292c326b-4ff3-43e3-b006-8fa336c8e348 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:20.831582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-292c326b-4ff3-43e3-b006-8fa336c8e348 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:20.968521 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-292c326b-4ff3-43e3-b006-8fa336c8e348 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:20.976651 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-292c326b-4ff3-43e3-b006-8fa336c8e348 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1365 microversion: 2.1 time: 0.172833 Sep 16 08:11:20.977969 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 426/808] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:20 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1365 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:21.171351 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b276fe33-0a78-473e-86f8-389f648262c8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:21.172159 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b276fe33-0a78-473e-86f8-389f648262c8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:21.179653 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b276fe33-0a78-473e-86f8-389f648262c8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:21.179854 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b276fe33-0a78-473e-86f8-389f648262c8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:21.180361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b276fe33-0a78-473e-86f8-389f648262c8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:21.181279 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b276fe33-0a78-473e-86f8-389f648262c8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:21.181933 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b276fe33-0a78-473e-86f8-389f648262c8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:21.182713 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b276fe33-0a78-473e-86f8-389f648262c8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:21.587761 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b276fe33-0a78-473e-86f8-389f648262c8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:21.599120 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b276fe33-0a78-473e-86f8-389f648262c8 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1200 microversion: 2.1 time: 0.432831 Sep 16 08:11:21.601618 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 383/809] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:21 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1200 bytes in 435 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:11:22.001633 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9c8457a6-96af-45b8-a656-5c0205cb36b4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:22.002456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-9c8457a6-96af-45b8-a656-5c0205cb36b4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:22.004981 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:22.010968 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9c8457a6-96af-45b8-a656-5c0205cb36b4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:22.011569 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9c8457a6-96af-45b8-a656-5c0205cb36b4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:22.012244 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9c8457a6-96af-45b8-a656-5c0205cb36b4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:22.013168 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9c8457a6-96af-45b8-a656-5c0205cb36b4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:22.014063 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9c8457a6-96af-45b8-a656-5c0205cb36b4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:22.014373 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9c8457a6-96af-45b8-a656-5c0205cb36b4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:22.193043 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-9c8457a6-96af-45b8-a656-5c0205cb36b4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:22.201857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9c8457a6-96af-45b8-a656-5c0205cb36b4 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1365 microversion: 2.1 time: 0.204618 Sep 16 08:11:22.214869 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 427/810] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:21 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1365 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:11:22.621755 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-05ac21ad-73c2-4a61-a967-a92999fae24a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:22.622975 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-05ac21ad-73c2-4a61-a967-a92999fae24a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:22.629744 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05ac21ad-73c2-4a61-a967-a92999fae24a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:22.630234 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05ac21ad-73c2-4a61-a967-a92999fae24a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:22.630706 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05ac21ad-73c2-4a61-a967-a92999fae24a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:22.631520 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05ac21ad-73c2-4a61-a967-a92999fae24a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:22.631979 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05ac21ad-73c2-4a61-a967-a92999fae24a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:22.632415 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-05ac21ad-73c2-4a61-a967-a92999fae24a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:22.801819 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-05ac21ad-73c2-4a61-a967-a92999fae24a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:22.812031 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-05ac21ad-73c2-4a61-a967-a92999fae24a tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1278 microversion: 2.1 time: 0.194200 Sep 16 08:11:22.812862 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 384/811] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:22 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1278 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:23.016841 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-5300893c-2e3c-49fa-a2f0-fa5af3542e29 req-c4d3dde7-0391-4448-a98a-d77cc7c1af3a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebeb7134-cf45-40d3-9e5a-b5f9164a8a87", "tag": "423ac706-d95d-479a-86fe-d25bef64dc6a"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:23.027800 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-5300893c-2e3c-49fa-a2f0-fa5af3542e29 req-c4d3dde7-0391-4448-a98a-d77cc7c1af3a service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:23.028936 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-5300893c-2e3c-49fa-a2f0-fa5af3542e29 req-c4d3dde7-0391-4448-a98a-d77cc7c1af3a service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:23.029674 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-5300893c-2e3c-49fa-a2f0-fa5af3542e29 req-c4d3dde7-0391-4448-a98a-d77cc7c1af3a service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:23.040766 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-5300893c-2e3c-49fa-a2f0-fa5af3542e29 req-c4d3dde7-0391-4448-a98a-d77cc7c1af3a service nova] Creating event network-changed:423ac706-d95d-479a-86fe-d25bef64dc6a for instance ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 on hv-cinder-74014 Sep 16 08:11:23.046315 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-5300893c-2e3c-49fa-a2f0-fa5af3542e29 req-c4d3dde7-0391-4448-a98a-d77cc7c1af3a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.033246 Sep 16 08:11:23.047013 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 428/812] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:23.225645 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-faf83481-a651-4be8-9581-e1dd2bd25440 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:23.226264 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-faf83481-a651-4be8-9581-e1dd2bd25440 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:23.233343 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-faf83481-a651-4be8-9581-e1dd2bd25440 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:23.233954 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-faf83481-a651-4be8-9581-e1dd2bd25440 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:23.234600 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-faf83481-a651-4be8-9581-e1dd2bd25440 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:23.235371 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-faf83481-a651-4be8-9581-e1dd2bd25440 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:23.235829 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-faf83481-a651-4be8-9581-e1dd2bd25440 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:23.236447 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-faf83481-a651-4be8-9581-e1dd2bd25440 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:23.241184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=100 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:23.382192 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-faf83481-a651-4be8-9581-e1dd2bd25440 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:23.390275 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-faf83481-a651-4be8-9581-e1dd2bd25440 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1365 microversion: 2.1 time: 0.168648 Sep 16 08:11:23.393707 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 385/813] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:23 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1365 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:23.698603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-b4b04a46-7cc4-4f18-9b90-61160549676d req-64b16ff4-ee7e-478f-8086-ea65fbe7e178 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f515fbb-b67a-402f-8768-d42e46423db1", "name": "network-vif-plugged", "status": "completed", "tag": "0952c557-1b1e-4f0b-84db-689b34cad324"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:23.711250 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b4b04a46-7cc4-4f18-9b90-61160549676d req-64b16ff4-ee7e-478f-8086-ea65fbe7e178 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:23.711732 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b4b04a46-7cc4-4f18-9b90-61160549676d req-64b16ff4-ee7e-478f-8086-ea65fbe7e178 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:23.712470 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-b4b04a46-7cc4-4f18-9b90-61160549676d req-64b16ff4-ee7e-478f-8086-ea65fbe7e178 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:23.727314 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-b4b04a46-7cc4-4f18-9b90-61160549676d req-64b16ff4-ee7e-478f-8086-ea65fbe7e178 service nova] Creating event network-vif-plugged:0952c557-1b1e-4f0b-84db-689b34cad324 for instance 6f515fbb-b67a-402f-8768-d42e46423db1 on hv-cinder-74014 Sep 16 08:11:23.733871 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-b4b04a46-7cc4-4f18-9b90-61160549676d req-64b16ff4-ee7e-478f-8086-ea65fbe7e178 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.038575 Sep 16 08:11:23.734470 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 429/814] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:11:23.837816 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-dbd64f52-1e19-4fb3-919b-1b24dec6cd31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:23.838381 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-dbd64f52-1e19-4fb3-919b-1b24dec6cd31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:23.851444 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dbd64f52-1e19-4fb3-919b-1b24dec6cd31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:23.851872 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dbd64f52-1e19-4fb3-919b-1b24dec6cd31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:23.852308 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dbd64f52-1e19-4fb3-919b-1b24dec6cd31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:23.853407 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dbd64f52-1e19-4fb3-919b-1b24dec6cd31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:23.853863 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dbd64f52-1e19-4fb3-919b-1b24dec6cd31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:23.854295 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dbd64f52-1e19-4fb3-919b-1b24dec6cd31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:24.008546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dbd64f52-1e19-4fb3-919b-1b24dec6cd31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:24.022707 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-dbd64f52-1e19-4fb3-919b-1b24dec6cd31 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1266 microversion: 2.1 time: 0.185513 Sep 16 08:11:24.033167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 386/815] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:23 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1266 bytes in 200 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:24.414214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cf7d51e8-9e30-4b04-9263-6eb7826e3c19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:24.414783 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cf7d51e8-9e30-4b04-9263-6eb7826e3c19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:24.416734 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=95,nova_api:UPDATE=2,nova_api:INSERT=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:24.421541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf7d51e8-9e30-4b04-9263-6eb7826e3c19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:24.422028 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf7d51e8-9e30-4b04-9263-6eb7826e3c19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:24.422468 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf7d51e8-9e30-4b04-9263-6eb7826e3c19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:24.423198 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf7d51e8-9e30-4b04-9263-6eb7826e3c19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:24.423660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf7d51e8-9e30-4b04-9263-6eb7826e3c19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:24.424089 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf7d51e8-9e30-4b04-9263-6eb7826e3c19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:24.559861 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cf7d51e8-9e30-4b04-9263-6eb7826e3c19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:24.567473 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cf7d51e8-9e30-4b04-9263-6eb7826e3c19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1365 microversion: 2.1 time: 0.158134 Sep 16 08:11:24.568037 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 430/816] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:24 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:24.912354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c4d8fffe-1c53-43a6-975a-a460664aafb3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:24.912874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c4d8fffe-1c53-43a6-975a-a460664aafb3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:24.915251 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=95,nova_api:DELETE=1,nova_api:INSERT=4 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:24.920443 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c4d8fffe-1c53-43a6-975a-a460664aafb3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:24.920919 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c4d8fffe-1c53-43a6-975a-a460664aafb3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:24.921355 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c4d8fffe-1c53-43a6-975a-a460664aafb3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:24.922043 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c4d8fffe-1c53-43a6-975a-a460664aafb3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:24.922569 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c4d8fffe-1c53-43a6-975a-a460664aafb3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:24.923022 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c4d8fffe-1c53-43a6-975a-a460664aafb3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:24.946827 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c4d8fffe-1c53-43a6-975a-a460664aafb3 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/ips" status: 200 len: 145 microversion: 2.1 time: 0.038311 Sep 16 08:11:24.947373 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 387/817] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Sep 16 08:11:24 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/ips => generated 145 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:11:25.043233 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-47de513c-13d5-4e55-8feb-ecb5c3dc9fb3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:25.044346 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-47de513c-13d5-4e55-8feb-ecb5c3dc9fb3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:25.051336 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-47de513c-13d5-4e55-8feb-ecb5c3dc9fb3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:25.051835 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-47de513c-13d5-4e55-8feb-ecb5c3dc9fb3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:25.052273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-47de513c-13d5-4e55-8feb-ecb5c3dc9fb3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:25.053000 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-47de513c-13d5-4e55-8feb-ecb5c3dc9fb3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:25.053456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-47de513c-13d5-4e55-8feb-ecb5c3dc9fb3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:25.053880 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-47de513c-13d5-4e55-8feb-ecb5c3dc9fb3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:25.183824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-47de513c-13d5-4e55-8feb-ecb5c3dc9fb3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:25.191896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-47de513c-13d5-4e55-8feb-ecb5c3dc9fb3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1266 microversion: 2.1 time: 0.152472 Sep 16 08:11:25.192460 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 431/818] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:25 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:25.591499 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2a193df0-2c64-42ce-8b31-875bf59cf7a8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:25.592121 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2a193df0-2c64-42ce-8b31-875bf59cf7a8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:25.598442 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a193df0-2c64-42ce-8b31-875bf59cf7a8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:25.598958 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a193df0-2c64-42ce-8b31-875bf59cf7a8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:25.599411 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a193df0-2c64-42ce-8b31-875bf59cf7a8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:25.600121 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a193df0-2c64-42ce-8b31-875bf59cf7a8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:25.600586 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a193df0-2c64-42ce-8b31-875bf59cf7a8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:25.601009 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a193df0-2c64-42ce-8b31-875bf59cf7a8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:25.736217 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2a193df0-2c64-42ce-8b31-875bf59cf7a8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:25.744090 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2a193df0-2c64-42ce-8b31-875bf59cf7a8 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1365 microversion: 2.1 time: 0.157419 Sep 16 08:11:25.744662 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 388/819] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:25 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1365 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:26.214542 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-467d0924-61ed-4b30-ac24-bbfa28da7d97 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:26.215228 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-467d0924-61ed-4b30-ac24-bbfa28da7d97 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:26.222544 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-467d0924-61ed-4b30-ac24-bbfa28da7d97 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:26.223081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-467d0924-61ed-4b30-ac24-bbfa28da7d97 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:26.223536 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-467d0924-61ed-4b30-ac24-bbfa28da7d97 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:26.224240 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-467d0924-61ed-4b30-ac24-bbfa28da7d97 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:26.224707 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-467d0924-61ed-4b30-ac24-bbfa28da7d97 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:26.225170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-467d0924-61ed-4b30-ac24-bbfa28da7d97 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:26.229368 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=100 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:26.360477 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-467d0924-61ed-4b30-ac24-bbfa28da7d97 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:26.368166 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-467d0924-61ed-4b30-ac24-bbfa28da7d97 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1266 microversion: 2.1 time: 0.157514 Sep 16 08:11:26.368791 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 432/820] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:26 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1266 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:26.552744 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7735890e-f2fa-4629-a9e9-644fa8d97474 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a169b670-236e-479e-b85a-44c9c894bcf1"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:26.556331 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7735890e-f2fa-4629-a9e9-644fa8d97474 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:26.562153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7735890e-f2fa-4629-a9e9-644fa8d97474 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:26.562749 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7735890e-f2fa-4629-a9e9-644fa8d97474 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:26.563287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7735890e-f2fa-4629-a9e9-644fa8d97474 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:26.563985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7735890e-f2fa-4629-a9e9-644fa8d97474 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:26.564438 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7735890e-f2fa-4629-a9e9-644fa8d97474 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:26.564866 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7735890e-f2fa-4629-a9e9-644fa8d97474 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:26.766833 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-941a26ac-681d-445e-820a-97144d0e669f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:26.767383 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-941a26ac-681d-445e-820a-97144d0e669f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:26.773477 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-941a26ac-681d-445e-820a-97144d0e669f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:26.773971 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-941a26ac-681d-445e-820a-97144d0e669f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:26.774412 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-941a26ac-681d-445e-820a-97144d0e669f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:26.775139 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-941a26ac-681d-445e-820a-97144d0e669f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:26.775602 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-941a26ac-681d-445e-820a-97144d0e669f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:26.776033 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-941a26ac-681d-445e-820a-97144d0e669f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:26.911162 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-941a26ac-681d-445e-820a-97144d0e669f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:26.918949 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-941a26ac-681d-445e-820a-97144d0e669f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1554 microversion: 2.1 time: 0.156664 Sep 16 08:11:26.919519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 433/821] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:26 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1554 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:11:26.941709 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d5adc09a-eb80-456a-bea1-cbd84f675ea3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:26.942194 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d5adc09a-eb80-456a-bea1-cbd84f675ea3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:26.948260 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5adc09a-eb80-456a-bea1-cbd84f675ea3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:26.948736 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5adc09a-eb80-456a-bea1-cbd84f675ea3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:26.949169 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5adc09a-eb80-456a-bea1-cbd84f675ea3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:26.949888 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5adc09a-eb80-456a-bea1-cbd84f675ea3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:26.950889 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5adc09a-eb80-456a-bea1-cbd84f675ea3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:26.951308 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d5adc09a-eb80-456a-bea1-cbd84f675ea3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:27.027282 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d5adc09a-eb80-456a-bea1-cbd84f675ea3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/os-interface" status: 200 len: 284 microversion: 2.1 time: 0.089175 Sep 16 08:11:27.035189 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 434/822] 10.222.0.59 () {58 vars in 1275 bytes} [Fri Sep 16 08:11:26 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/os-interface => generated 284 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:11:27.229890 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:27.387083 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7735890e-f2fa-4629-a9e9-644fa8d97474 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "POST /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.838155 Sep 16 08:11:27.390755 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 389/823] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:11:26 2022] POST /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments => generated 194 bytes in 840 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:27.396691 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-17722b5d-35dd-4a4e-bcf9-32bf411e7fe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:27.397327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-17722b5d-35dd-4a4e-bcf9-32bf411e7fe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:27.405160 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-17722b5d-35dd-4a4e-bcf9-32bf411e7fe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:27.405959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-17722b5d-35dd-4a4e-bcf9-32bf411e7fe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:27.406408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-17722b5d-35dd-4a4e-bcf9-32bf411e7fe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:27.407146 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-17722b5d-35dd-4a4e-bcf9-32bf411e7fe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:27.407614 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-17722b5d-35dd-4a4e-bcf9-32bf411e7fe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:27.408047 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-17722b5d-35dd-4a4e-bcf9-32bf411e7fe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:27.598432 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-17722b5d-35dd-4a4e-bcf9-32bf411e7fe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:27.607119 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-17722b5d-35dd-4a4e-bcf9-32bf411e7fe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1266 microversion: 2.1 time: 0.220177 Sep 16 08:11:27.608016 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 435/824] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:27 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1266 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:28.083167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-4ef1d305-f537-4ea5-8374-1826b1e41975 req-3ef0abe0-4df5-424c-903e-33dfc89e1282 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "6f515fbb-b67a-402f-8768-d42e46423db1", "tag": "0952c557-1b1e-4f0b-84db-689b34cad324"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:28.088194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=5 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:28.094184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-4ef1d305-f537-4ea5-8374-1826b1e41975 req-3ef0abe0-4df5-424c-903e-33dfc89e1282 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:28.094666 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-4ef1d305-f537-4ea5-8374-1826b1e41975 req-3ef0abe0-4df5-424c-903e-33dfc89e1282 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:28.095122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-4ef1d305-f537-4ea5-8374-1826b1e41975 req-3ef0abe0-4df5-424c-903e-33dfc89e1282 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:28.106157 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-4ef1d305-f537-4ea5-8374-1826b1e41975 req-3ef0abe0-4df5-424c-903e-33dfc89e1282 service nova] Creating event network-changed:0952c557-1b1e-4f0b-84db-689b34cad324 for instance 6f515fbb-b67a-402f-8768-d42e46423db1 on hv-cinder-74014 Sep 16 08:11:28.111126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-4ef1d305-f537-4ea5-8374-1826b1e41975 req-3ef0abe0-4df5-424c-903e-33dfc89e1282 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032043 Sep 16 08:11:28.111725 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 390/825] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:28 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:28.629647 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-eeb56702-9d40-4e31-ae42-85810ea4f109 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:28.631094 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-eeb56702-9d40-4e31-ae42-85810ea4f109 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:28.632939 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=10 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:28.638329 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eeb56702-9d40-4e31-ae42-85810ea4f109 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:28.638973 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eeb56702-9d40-4e31-ae42-85810ea4f109 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:28.639424 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eeb56702-9d40-4e31-ae42-85810ea4f109 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:28.640126 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eeb56702-9d40-4e31-ae42-85810ea4f109 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:28.641083 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eeb56702-9d40-4e31-ae42-85810ea4f109 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:28.641974 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eeb56702-9d40-4e31-ae42-85810ea4f109 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:28.801772 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-eeb56702-9d40-4e31-ae42-85810ea4f109 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:28.810528 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-eeb56702-9d40-4e31-ae42-85810ea4f109 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1266 microversion: 2.1 time: 0.184895 Sep 16 08:11:28.813117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 436/826] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:28 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1266 bytes in 187 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:29.835251 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f4fa4d12-c339-439d-a0ae-6e0ea33e56a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:29.835898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f4fa4d12-c339-439d-a0ae-6e0ea33e56a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:29.842221 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f4fa4d12-c339-439d-a0ae-6e0ea33e56a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:29.842726 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f4fa4d12-c339-439d-a0ae-6e0ea33e56a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:29.843170 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f4fa4d12-c339-439d-a0ae-6e0ea33e56a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:29.843863 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f4fa4d12-c339-439d-a0ae-6e0ea33e56a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:29.844315 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f4fa4d12-c339-439d-a0ae-6e0ea33e56a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:29.844741 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f4fa4d12-c339-439d-a0ae-6e0ea33e56a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:29.974376 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f4fa4d12-c339-439d-a0ae-6e0ea33e56a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:29.982714 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f4fa4d12-c339-439d-a0ae-6e0ea33e56a0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1266 microversion: 2.1 time: 0.152677 Sep 16 08:11:29.983284 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 391/827] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:29 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1266 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:31.005676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ca391fa4-af69-452d-a8a0-85d680a342d9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:31.006288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ca391fa4-af69-452d-a8a0-85d680a342d9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:31.012652 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ca391fa4-af69-452d-a8a0-85d680a342d9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:31.013132 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ca391fa4-af69-452d-a8a0-85d680a342d9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:31.013567 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ca391fa4-af69-452d-a8a0-85d680a342d9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:31.014252 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ca391fa4-af69-452d-a8a0-85d680a342d9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:31.015270 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ca391fa4-af69-452d-a8a0-85d680a342d9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:31.015698 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ca391fa4-af69-452d-a8a0-85d680a342d9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:31.148956 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ca391fa4-af69-452d-a8a0-85d680a342d9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:31.156906 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ca391fa4-af69-452d-a8a0-85d680a342d9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1266 microversion: 2.1 time: 0.155077 Sep 16 08:11:31.157463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 437/828] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:31 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1266 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:32.179569 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-bb38d0da-af9a-4e80-8493-b65554e63b14 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:32.180128 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-bb38d0da-af9a-4e80-8493-b65554e63b14 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:32.186289 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb38d0da-af9a-4e80-8493-b65554e63b14 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:32.186855 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb38d0da-af9a-4e80-8493-b65554e63b14 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:32.187296 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb38d0da-af9a-4e80-8493-b65554e63b14 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:32.188003 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb38d0da-af9a-4e80-8493-b65554e63b14 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:32.188465 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb38d0da-af9a-4e80-8493-b65554e63b14 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:32.188897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb38d0da-af9a-4e80-8493-b65554e63b14 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:32.321367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-bb38d0da-af9a-4e80-8493-b65554e63b14 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:32.334294 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-bb38d0da-af9a-4e80-8493-b65554e63b14 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1266 microversion: 2.1 time: 0.159198 Sep 16 08:11:32.356390 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 392/829] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:32 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1266 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:33.360187 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-679b12ba-e26d-4b6d-a4cd-db87e52cf538 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:33.360879 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-679b12ba-e26d-4b6d-a4cd-db87e52cf538 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:33.367340 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-679b12ba-e26d-4b6d-a4cd-db87e52cf538 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:33.367826 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-679b12ba-e26d-4b6d-a4cd-db87e52cf538 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:33.368266 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-679b12ba-e26d-4b6d-a4cd-db87e52cf538 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:33.368957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-679b12ba-e26d-4b6d-a4cd-db87e52cf538 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:33.369417 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-679b12ba-e26d-4b6d-a4cd-db87e52cf538 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:33.369841 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-679b12ba-e26d-4b6d-a4cd-db87e52cf538 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:33.513007 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-679b12ba-e26d-4b6d-a4cd-db87e52cf538 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:33.524753 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-679b12ba-e26d-4b6d-a4cd-db87e52cf538 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1266 microversion: 2.1 time: 0.169254 Sep 16 08:11:33.525315 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 438/830] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:33 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:33.792588 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-2a556b2e-28ab-458d-9439-3df224078c29 req-a112f005-be2b-4c6a-98e8-d2564a23998d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebeb7134-cf45-40d3-9e5a-b5f9164a8a87", "name": "network-vif-plugged", "status": "completed", "tag": "423ac706-d95d-479a-86fe-d25bef64dc6a"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:33.809968 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-2a556b2e-28ab-458d-9439-3df224078c29 req-a112f005-be2b-4c6a-98e8-d2564a23998d service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:33.809968 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-2a556b2e-28ab-458d-9439-3df224078c29 req-a112f005-be2b-4c6a-98e8-d2564a23998d service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:33.809968 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-2a556b2e-28ab-458d-9439-3df224078c29 req-a112f005-be2b-4c6a-98e8-d2564a23998d service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:33.815582 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-2a556b2e-28ab-458d-9439-3df224078c29 req-a112f005-be2b-4c6a-98e8-d2564a23998d service nova] Creating event network-vif-plugged:423ac706-d95d-479a-86fe-d25bef64dc6a for instance ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 on hv-cinder-74014 Sep 16 08:11:33.821016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-2a556b2e-28ab-458d-9439-3df224078c29 req-a112f005-be2b-4c6a-98e8-d2564a23998d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032083 Sep 16 08:11:33.821610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 393/831] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:33 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:11:34.548194 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-69c26ceb-0dcd-4d46-8a15-4013420d794e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:34.548810 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-69c26ceb-0dcd-4d46-8a15-4013420d794e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:34.555816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-69c26ceb-0dcd-4d46-8a15-4013420d794e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:34.557613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-69c26ceb-0dcd-4d46-8a15-4013420d794e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:34.557613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-69c26ceb-0dcd-4d46-8a15-4013420d794e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:34.557613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-69c26ceb-0dcd-4d46-8a15-4013420d794e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:34.558022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-69c26ceb-0dcd-4d46-8a15-4013420d794e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:34.558457 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-69c26ceb-0dcd-4d46-8a15-4013420d794e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:34.709645 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-69c26ceb-0dcd-4d46-8a15-4013420d794e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:34.717419 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-69c26ceb-0dcd-4d46-8a15-4013420d794e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1266 microversion: 2.1 time: 0.173898 Sep 16 08:11:34.718027 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 439/832] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:34 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1266 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:35.740599 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5d34c558-7db0-4db1-acdf-971ef4bd5671 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:35.741640 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5d34c558-7db0-4db1-acdf-971ef4bd5671 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:35.748046 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5d34c558-7db0-4db1-acdf-971ef4bd5671 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:35.748550 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5d34c558-7db0-4db1-acdf-971ef4bd5671 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:35.749488 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5d34c558-7db0-4db1-acdf-971ef4bd5671 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:35.750184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5d34c558-7db0-4db1-acdf-971ef4bd5671 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:35.750642 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5d34c558-7db0-4db1-acdf-971ef4bd5671 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:35.751100 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5d34c558-7db0-4db1-acdf-971ef4bd5671 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:35.881317 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5d34c558-7db0-4db1-acdf-971ef4bd5671 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:35.888954 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5d34c558-7db0-4db1-acdf-971ef4bd5671 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1266 microversion: 2.1 time: 0.152733 Sep 16 08:11:35.890243 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 394/833] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:35 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1266 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:36.036406 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e9c0948e-aafb-4c2d-8267-d7af99e20729 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:36.038594 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e9c0948e-aafb-4c2d-8267-d7af99e20729 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:36.045031 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e9c0948e-aafb-4c2d-8267-d7af99e20729 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:36.045524 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e9c0948e-aafb-4c2d-8267-d7af99e20729 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:36.046465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e9c0948e-aafb-4c2d-8267-d7af99e20729 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:36.047188 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e9c0948e-aafb-4c2d-8267-d7af99e20729 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:36.047651 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e9c0948e-aafb-4c2d-8267-d7af99e20729 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:36.048081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e9c0948e-aafb-4c2d-8267-d7af99e20729 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:36.077980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e9c0948e-aafb-4c2d-8267-d7af99e20729 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.045400 Sep 16 08:11:36.078453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 440/834] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:11:36 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments => generated 197 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:36.089212 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a5f4138e-9619-421e-ba25-54985cf945b0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:36.089712 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a5f4138e-9619-421e-ba25-54985cf945b0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:36.095617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5f4138e-9619-421e-ba25-54985cf945b0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:36.096107 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5f4138e-9619-421e-ba25-54985cf945b0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:36.096550 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5f4138e-9619-421e-ba25-54985cf945b0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:36.097250 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5f4138e-9619-421e-ba25-54985cf945b0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:36.097710 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5f4138e-9619-421e-ba25-54985cf945b0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:36.098142 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5f4138e-9619-421e-ba25-54985cf945b0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:36.126994 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a5f4138e-9619-421e-ba25-54985cf945b0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments/a169b670-236e-479e-b85a-44c9c894bcf1" status: 200 len: 194 microversion: 2.1 time: 0.041838 Sep 16 08:11:36.127559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 395/835] 10.222.0.59 () {58 vars in 1413 bytes} [Fri Sep 16 08:11:36 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments/a169b670-236e-479e-b85a-44c9c894bcf1 => generated 194 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:36.913135 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-218e1838-d1e0-4586-99a2-06e6164f5755 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:36.913669 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-218e1838-d1e0-4586-99a2-06e6164f5755 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:36.919606 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-218e1838-d1e0-4586-99a2-06e6164f5755 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:36.920087 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-218e1838-d1e0-4586-99a2-06e6164f5755 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:36.920525 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-218e1838-d1e0-4586-99a2-06e6164f5755 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:36.921209 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-218e1838-d1e0-4586-99a2-06e6164f5755 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:36.921667 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-218e1838-d1e0-4586-99a2-06e6164f5755 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:36.922087 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-218e1838-d1e0-4586-99a2-06e6164f5755 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:37.053094 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-218e1838-d1e0-4586-99a2-06e6164f5755 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:37.060809 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-218e1838-d1e0-4586-99a2-06e6164f5755 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1453 microversion: 2.1 time: 0.151696 Sep 16 08:11:37.061909 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 441/836] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:36 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:37.083851 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-daf8fcd8-30ab-4c7f-bacf-6a3c7a6f4e88 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:37.084847 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-daf8fcd8-30ab-4c7f-bacf-6a3c7a6f4e88 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:37.091330 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-daf8fcd8-30ab-4c7f-bacf-6a3c7a6f4e88 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:37.091815 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-daf8fcd8-30ab-4c7f-bacf-6a3c7a6f4e88 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:37.092260 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-daf8fcd8-30ab-4c7f-bacf-6a3c7a6f4e88 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:37.092952 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-daf8fcd8-30ab-4c7f-bacf-6a3c7a6f4e88 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:37.093409 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-daf8fcd8-30ab-4c7f-bacf-6a3c7a6f4e88 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:37.093840 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-daf8fcd8-30ab-4c7f-bacf-6a3c7a6f4e88 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:37.224924 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-daf8fcd8-30ab-4c7f-bacf-6a3c7a6f4e88 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:37.232787 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-daf8fcd8-30ab-4c7f-bacf-6a3c7a6f4e88 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1453 microversion: 2.1 time: 0.152982 Sep 16 08:11:37.233512 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 396/837] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:37 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1453 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:37.702014 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8969d418-2321-4ba3-9405-e19ef7053072 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "c9509db2-d6c7-45d5-bb22-e7b189a42451"}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:37.704379 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8969d418-2321-4ba3-9405-e19ef7053072 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:37.710299 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8969d418-2321-4ba3-9405-e19ef7053072 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:37.710824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8969d418-2321-4ba3-9405-e19ef7053072 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:37.711267 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8969d418-2321-4ba3-9405-e19ef7053072 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:37.711961 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8969d418-2321-4ba3-9405-e19ef7053072 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:37.712420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8969d418-2321-4ba3-9405-e19ef7053072 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:37.712852 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8969d418-2321-4ba3-9405-e19ef7053072 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:38.524532 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8969d418-2321-4ba3-9405-e19ef7053072 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "POST /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.826401 Sep 16 08:11:38.525332 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 442/838] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:11:37 2022] POST /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments => generated 194 bytes in 828 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:39.424032 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-fda9fdc2-80a4-4e84-aa58-0cd711e7c48c req-bf84fc9a-9181-4875-ab88-44f28b39da20 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebeb7134-cf45-40d3-9e5a-b5f9164a8a87", "tag": "423ac706-d95d-479a-86fe-d25bef64dc6a"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:39.442228 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-fda9fdc2-80a4-4e84-aa58-0cd711e7c48c req-bf84fc9a-9181-4875-ab88-44f28b39da20 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:39.442228 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-fda9fdc2-80a4-4e84-aa58-0cd711e7c48c req-bf84fc9a-9181-4875-ab88-44f28b39da20 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:39.442228 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-fda9fdc2-80a4-4e84-aa58-0cd711e7c48c req-bf84fc9a-9181-4875-ab88-44f28b39da20 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:39.445421 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-fda9fdc2-80a4-4e84-aa58-0cd711e7c48c req-bf84fc9a-9181-4875-ab88-44f28b39da20 service nova] Creating event network-changed:423ac706-d95d-479a-86fe-d25bef64dc6a for instance ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 on hv-cinder-74014 Sep 16 08:11:39.450340 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-fda9fdc2-80a4-4e84-aa58-0cd711e7c48c req-bf84fc9a-9181-4875-ab88-44f28b39da20 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.029942 Sep 16 08:11:39.450963 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 397/839] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 31 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:47.132636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-51b4e47d-c32d-4282-b06a-c26c086fcd65 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:47.135560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-51b4e47d-c32d-4282-b06a-c26c086fcd65 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:47.142962 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-51b4e47d-c32d-4282-b06a-c26c086fcd65 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:47.143452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-51b4e47d-c32d-4282-b06a-c26c086fcd65 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:47.144753 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-51b4e47d-c32d-4282-b06a-c26c086fcd65 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:47.144753 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-51b4e47d-c32d-4282-b06a-c26c086fcd65 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:47.145028 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-51b4e47d-c32d-4282-b06a-c26c086fcd65 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:47.145456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-51b4e47d-c32d-4282-b06a-c26c086fcd65 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:47.174885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-51b4e47d-c32d-4282-b06a-c26c086fcd65 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments" status: 200 len: 371 microversion: 2.1 time: 0.047223 Sep 16 08:11:47.175447 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 443/840] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:11:47 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments => generated 371 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:47.342152 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fa2a53ea-6bc5-4b79-8b10-d325fd53455a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:47.342790 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-fa2a53ea-6bc5-4b79-8b10-d325fd53455a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:47.349048 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fa2a53ea-6bc5-4b79-8b10-d325fd53455a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:47.349531 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fa2a53ea-6bc5-4b79-8b10-d325fd53455a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:47.349970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fa2a53ea-6bc5-4b79-8b10-d325fd53455a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:47.350663 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fa2a53ea-6bc5-4b79-8b10-d325fd53455a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:47.351150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fa2a53ea-6bc5-4b79-8b10-d325fd53455a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:47.351579 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fa2a53ea-6bc5-4b79-8b10-d325fd53455a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:47.379909 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-fa2a53ea-6bc5-4b79-8b10-d325fd53455a tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments/a169b670-236e-479e-b85a-44c9c894bcf1" status: 200 len: 194 microversion: 2.1 time: 0.042729 Sep 16 08:11:47.380489 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 398/841] 10.222.0.59 () {58 vars in 1413 bytes} [Fri Sep 16 08:11:47 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments/a169b670-236e-479e-b85a-44c9c894bcf1 => generated 194 bytes in 44 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:47.390893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7b1bbbb2-3b26-4a10-8ad6-426ec6b2991f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:47.391454 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7b1bbbb2-3b26-4a10-8ad6-426ec6b2991f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:47.397961 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b1bbbb2-3b26-4a10-8ad6-426ec6b2991f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:47.398441 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b1bbbb2-3b26-4a10-8ad6-426ec6b2991f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:47.398910 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b1bbbb2-3b26-4a10-8ad6-426ec6b2991f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:47.399598 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b1bbbb2-3b26-4a10-8ad6-426ec6b2991f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:47.400054 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b1bbbb2-3b26-4a10-8ad6-426ec6b2991f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:47.400480 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b1bbbb2-3b26-4a10-8ad6-426ec6b2991f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:47.487663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-7b1bbbb2-3b26-4a10-8ad6-426ec6b2991f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lazy-loading 'services' on Instance uuid 172d6ac8-f22f-4167-b9c2-4da9eef51e88 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:11:47.708886 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7b1bbbb2-3b26-4a10-8ad6-426ec6b2991f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "DELETE /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments/a169b670-236e-479e-b85a-44c9c894bcf1" status: 202 len: 0 microversion: 2.1 time: 0.321687 Sep 16 08:11:47.709616 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 444/842] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Sep 16 08:11:47 2022] DELETE /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments/a169b670-236e-479e-b85a-44c9c894bcf1 => generated 0 bytes in 323 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:11:49.900763 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5d423529-0eda-43c8-8949-588afe7cd8ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:49.901287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5d423529-0eda-43c8-8949-588afe7cd8ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:49.908069 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5d423529-0eda-43c8-8949-588afe7cd8ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:49.908550 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5d423529-0eda-43c8-8949-588afe7cd8ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:49.908985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5d423529-0eda-43c8-8949-588afe7cd8ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:49.909672 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5d423529-0eda-43c8-8949-588afe7cd8ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:49.910125 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5d423529-0eda-43c8-8949-588afe7cd8ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:49.910549 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5d423529-0eda-43c8-8949-588afe7cd8ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:49.941667 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5d423529-0eda-43c8-8949-588afe7cd8ce tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments/c9509db2-d6c7-45d5-bb22-e7b189a42451" status: 200 len: 194 microversion: 2.1 time: 0.044842 Sep 16 08:11:49.947582 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 399/843] 10.222.0.59 () {58 vars in 1413 bytes} [Fri Sep 16 08:11:49 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments/c9509db2-d6c7-45d5-bb22-e7b189a42451 => generated 194 bytes in 46 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:49.957406 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a89d6fb5-8368-4d7d-bed5-3834ed53084c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:49.957406 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a89d6fb5-8368-4d7d-bed5-3834ed53084c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:49.961098 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a89d6fb5-8368-4d7d-bed5-3834ed53084c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:49.961600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a89d6fb5-8368-4d7d-bed5-3834ed53084c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:49.962045 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a89d6fb5-8368-4d7d-bed5-3834ed53084c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:49.962774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a89d6fb5-8368-4d7d-bed5-3834ed53084c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:49.963235 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a89d6fb5-8368-4d7d-bed5-3834ed53084c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:49.963803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a89d6fb5-8368-4d7d-bed5-3834ed53084c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:50.044336 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-a89d6fb5-8368-4d7d-bed5-3834ed53084c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lazy-loading 'services' on Instance uuid 172d6ac8-f22f-4167-b9c2-4da9eef51e88 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:11:50.233857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a89d6fb5-8368-4d7d-bed5-3834ed53084c tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "DELETE /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments/c9509db2-d6c7-45d5-bb22-e7b189a42451" status: 202 len: 0 microversion: 2.1 time: 0.284536 Sep 16 08:11:50.234415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 445/844] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Sep 16 08:11:49 2022] DELETE /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments/c9509db2-d6c7-45d5-bb22-e7b189a42451 => generated 0 bytes in 286 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:11:52.467798 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d46503e0-da21-41ff-a0c2-016e863349a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:52.470044 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d46503e0-da21-41ff-a0c2-016e863349a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:52.476500 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d46503e0-da21-41ff-a0c2-016e863349a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:52.476986 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d46503e0-da21-41ff-a0c2-016e863349a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:52.477425 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d46503e0-da21-41ff-a0c2-016e863349a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:52.478174 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d46503e0-da21-41ff-a0c2-016e863349a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:52.478628 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d46503e0-da21-41ff-a0c2-016e863349a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:52.479084 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d46503e0-da21-41ff-a0c2-016e863349a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:52.508113 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d46503e0-da21-41ff-a0c2-016e863349a7 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.044309 Sep 16 08:11:52.508669 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 400/845] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:11:52 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments => generated 25 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 08:11:52.626364 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c14fe269-787d-4e91-888f-d4df60aa92b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:52.629464 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c14fe269-787d-4e91-888f-d4df60aa92b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:52.635794 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c14fe269-787d-4e91-888f-d4df60aa92b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:52.636362 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c14fe269-787d-4e91-888f-d4df60aa92b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:52.636915 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c14fe269-787d-4e91-888f-d4df60aa92b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:52.637668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c14fe269-787d-4e91-888f-d4df60aa92b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:52.638124 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c14fe269-787d-4e91-888f-d4df60aa92b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:52.638546 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c14fe269-787d-4e91-888f-d4df60aa92b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:52.656802 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=2,nova_cell1:INSERT=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:52.668673 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c14fe269-787d-4e91-888f-d4df60aa92b4 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.047233 Sep 16 08:11:52.670857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 446/846] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:11:52 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88/os-volume_attachments => generated 25 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 08:11:52.732068 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-70037214-ec12-4081-8141-27c3fa5e0350 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:52.732571 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-70037214-ec12-4081-8141-27c3fa5e0350 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:52.739235 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-70037214-ec12-4081-8141-27c3fa5e0350 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:52.739723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-70037214-ec12-4081-8141-27c3fa5e0350 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:52.740170 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-70037214-ec12-4081-8141-27c3fa5e0350 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:52.740925 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-70037214-ec12-4081-8141-27c3fa5e0350 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:52.741386 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-70037214-ec12-4081-8141-27c3fa5e0350 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:52.741824 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-70037214-ec12-4081-8141-27c3fa5e0350 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:52.769839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-70037214-ec12-4081-8141-27c3fa5e0350 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Going to try to terminate instance {{(pid=121047) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:11:52.805204 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=96,nova_cell1:UPDATE=3,nova_cell1:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:53.070501 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-70037214-ec12-4081-8141-27c3fa5e0350 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "DELETE /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 204 len: 0 microversion: 2.1 time: 0.340151 Sep 16 08:11:53.070501 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 401/847] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:11:52 2022] DELETE /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 0 bytes in 342 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:11:53.077505 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-442f5140-1dd7-4964-bea1-adcd3ce8a17f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:53.078113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-442f5140-1dd7-4964-bea1-adcd3ce8a17f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:53.084642 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-442f5140-1dd7-4964-bea1-adcd3ce8a17f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:53.085130 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-442f5140-1dd7-4964-bea1-adcd3ce8a17f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:53.085567 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-442f5140-1dd7-4964-bea1-adcd3ce8a17f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:53.086250 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-442f5140-1dd7-4964-bea1-adcd3ce8a17f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:53.086726 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-442f5140-1dd7-4964-bea1-adcd3ce8a17f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:53.087155 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-442f5140-1dd7-4964-bea1-adcd3ce8a17f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:53.221624 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-442f5140-1dd7-4964-bea1-adcd3ce8a17f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:53.229351 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-442f5140-1dd7-4964-bea1-adcd3ce8a17f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1674 microversion: 2.1 time: 0.155643 Sep 16 08:11:53.229926 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 447/848] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:53 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:54.254913 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2087c56f-8dbc-400c-b0d1-d99969e43328 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:54.255620 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2087c56f-8dbc-400c-b0d1-d99969e43328 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:54.262615 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2087c56f-8dbc-400c-b0d1-d99969e43328 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:54.263152 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2087c56f-8dbc-400c-b0d1-d99969e43328 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:54.263597 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2087c56f-8dbc-400c-b0d1-d99969e43328 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:54.264304 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2087c56f-8dbc-400c-b0d1-d99969e43328 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:54.264769 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2087c56f-8dbc-400c-b0d1-d99969e43328 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:54.265202 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2087c56f-8dbc-400c-b0d1-d99969e43328 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:54.398153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2087c56f-8dbc-400c-b0d1-d99969e43328 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:54.404922 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2087c56f-8dbc-400c-b0d1-d99969e43328 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1674 microversion: 2.1 time: 0.155127 Sep 16 08:11:54.405468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 402/849] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:54 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1674 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:55.429551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b315deeb-1702-4c3a-a082-7782407b7a1f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:55.430174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b315deeb-1702-4c3a-a082-7782407b7a1f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:55.432572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=36 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:55.437398 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b315deeb-1702-4c3a-a082-7782407b7a1f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:55.440204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b315deeb-1702-4c3a-a082-7782407b7a1f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:55.440204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b315deeb-1702-4c3a-a082-7782407b7a1f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:55.440204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b315deeb-1702-4c3a-a082-7782407b7a1f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:55.440204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b315deeb-1702-4c3a-a082-7782407b7a1f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:55.440574 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b315deeb-1702-4c3a-a082-7782407b7a1f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:55.853283 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b315deeb-1702-4c3a-a082-7782407b7a1f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:55.862162 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b315deeb-1702-4c3a-a082-7782407b7a1f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1674 microversion: 2.1 time: 0.436912 Sep 16 08:11:55.870307 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 448/850] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:55 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1674 bytes in 439 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:56.508007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-c5fc72a7-4ef4-4d0b-b2be-a6551990fa40 req-3163be40-07ab-4814-a52f-809a55f563ce service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "172d6ac8-f22f-4167-b9c2-4da9eef51e88", "name": "network-vif-deleted", "tag": "ed18c377-ec53-4436-81b8-4ffcc88a10c0"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:56.513423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=37,nova_api:UPDATE=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:11:56.527361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-c5fc72a7-4ef4-4d0b-b2be-a6551990fa40 req-3163be40-07ab-4814-a52f-809a55f563ce service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:56.527842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-c5fc72a7-4ef4-4d0b-b2be-a6551990fa40 req-3163be40-07ab-4814-a52f-809a55f563ce service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:56.528274 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-c5fc72a7-4ef4-4d0b-b2be-a6551990fa40 req-3163be40-07ab-4814-a52f-809a55f563ce service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:56.546232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-c5fc72a7-4ef4-4d0b-b2be-a6551990fa40 req-3163be40-07ab-4814-a52f-809a55f563ce service nova] Creating event network-vif-deleted:ed18c377-ec53-4436-81b8-4ffcc88a10c0 for instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 on hv-cinder-74014 Sep 16 08:11:56.553201 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-c5fc72a7-4ef4-4d0b-b2be-a6551990fa40 req-3163be40-07ab-4814-a52f-809a55f563ce service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048752 Sep 16 08:11:56.554031 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 403/851] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:11:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:11:56.653752 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-fa650995-03e2-4ab0-baa1-4289f9b8c0b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:56.654540 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-fa650995-03e2-4ab0-baa1-4289f9b8c0b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:56.666582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fa650995-03e2-4ab0-baa1-4289f9b8c0b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:56.668691 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fa650995-03e2-4ab0-baa1-4289f9b8c0b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:56.669793 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fa650995-03e2-4ab0-baa1-4289f9b8c0b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:56.670804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fa650995-03e2-4ab0-baa1-4289f9b8c0b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:56.671692 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fa650995-03e2-4ab0-baa1-4289f9b8c0b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:56.672347 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fa650995-03e2-4ab0-baa1-4289f9b8c0b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:56.704035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-fa650995-03e2-4ab0-baa1-4289f9b8c0b2 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/ips" status: 200 len: 152 microversion: 2.20 time: 0.054131 Sep 16 08:11:56.706764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 449/852] 10.222.0.59 () {60 vars in 1289 bytes} [Fri Sep 16 08:11:56 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/ips => generated 152 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 08:11:56.889498 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:56.890232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:56.898315 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:56.898835 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:56.899263 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:56.899962 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:56.900410 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:56.900864 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:56.932584 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:56.933067 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:56.933504 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:56.934138 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lazy-loading 'fault' on Instance uuid 172d6ac8-f22f-4167-b9c2-4da9eef51e88 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:11:56.982542 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '393fddf9c75447fab334b84694dcf4f1', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '45838a0f741e485e8f424375c6d0d489', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:11:56.991006 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9adbaf78-a0ca-4455-9da0-2ed9162fcf3e tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 200 len: 1328 microversion: 2.1 time: 0.107044 Sep 16 08:11:56.992566 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 404/853] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:56 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 1328 bytes in 109 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:11:58.015069 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7bf95b60-46ec-44e8-b8d4-05386ce0adcd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:58.015782 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7bf95b60-46ec-44e8-b8d4-05386ce0adcd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:58.022904 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7bf95b60-46ec-44e8-b8d4-05386ce0adcd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:58.023396 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7bf95b60-46ec-44e8-b8d4-05386ce0adcd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:58.023838 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7bf95b60-46ec-44e8-b8d4-05386ce0adcd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:58.024538 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7bf95b60-46ec-44e8-b8d4-05386ce0adcd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:58.024996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7bf95b60-46ec-44e8-b8d4-05386ce0adcd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:58.025459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7bf95b60-46ec-44e8-b8d4-05386ce0adcd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:58.039633 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-7bf95b60-46ec-44e8-b8d4-05386ce0adcd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] HTTP exception thrown: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7bf95b60-46ec-44e8-b8d4-05386ce0adcd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Request method failure captured: Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 HTTP/1.1 Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5Hk4j_hjkfTYRalbAq7nKYw4un_VSdFpY9pPls5xpTZuPtwEbByuSCvNtEc66xwWeTjpgYOCh4UqNanlMOuJNnx-H_Lb5jOcR4Gk7-HtkwYrbz5YXG6rBjO6fKEjnfhzS6G30okaMCloyyOID1PArRtHdiRbl2kj-ouy60IMAUU74 Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 45838a0f741e485e8f424375c6d0d489 Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:11:58.041277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:11:58.043005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_45838a0f741e485e8f424375c6d0d489", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:11:58.043005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:11:58.043005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 45838a0f741e485e8f424375c6d0d489 Sep 16 08:11:58.043005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:11:58.043005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-AttachVolumeTestJSON-1548693197-project Sep 16 08:11:58.043005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:11:58.043005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:11:58.043005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: 393fddf9c75447fab334b84694dcf4f1 Sep 16 08:11:58.043005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-AttachVolumeTestJSON-1548693197-project Sep 16 08:11:58.043005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:11:58.043005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:11:58.043005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '172d6ac8-f22f-4167-b9c2-4da9eef51e88'} Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:11:58.043866 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:11:58.045334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:11:58.046865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7bf95b60-46ec-44e8-b8d4-05386ce0adcd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Returning 404 to user: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:11:58.046865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7bf95b60-46ec-44e8-b8d4-05386ce0adcd tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 404 len: 111 microversion: 2.1 time: 0.031624 Sep 16 08:11:58.046865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 450/854] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:11:58 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:11:58.052236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ca5a8a3f-bbf3-4817-b04e-9ed52817f511 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '.version_select at 0x7f9d0690f670>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:11:58.139439 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ca5a8a3f-bbf3-4817-b04e-9ed52817f511 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1160767336" status: 202 len: 0 microversion: 2.1 time: 0.091078 Sep 16 08:11:58.140302 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 405/855] 10.222.0.59 () {58 vars in 1221 bytes} [Fri Sep 16 08:11:58 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1160767336 => generated 0 bytes in 92 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:11:59.716810 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-45abd9e0-ff5b-4938-843c-ffe1429f29a6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:11:59.717480 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-45abd9e0-ff5b-4938-843c-ffe1429f29a6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:11:59.725569 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45abd9e0-ff5b-4938-843c-ffe1429f29a6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:59.726091 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45abd9e0-ff5b-4938-843c-ffe1429f29a6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:59.726545 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45abd9e0-ff5b-4938-843c-ffe1429f29a6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:59.731095 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45abd9e0-ff5b-4938-843c-ffe1429f29a6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:11:59.731592 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45abd9e0-ff5b-4938-843c-ffe1429f29a6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:11:59.732041 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-45abd9e0-ff5b-4938-843c-ffe1429f29a6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:11:59.755536 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-45abd9e0-ff5b-4938-843c-ffe1429f29a6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lazy-loading 'flavor' on Instance uuid 7f6b33b5-7327-4c2f-ae74-6f718e860360 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:12:00.170458 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-45abd9e0-ff5b-4938-843c-ffe1429f29a6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "POST /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/action" status: 202 len: 0 microversion: 2.20 time: 0.457359 Sep 16 08:12:00.171081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 451/856] 10.222.0.59 () {62 vars in 1319 bytes} [Fri Sep 16 08:11:59 2022] POST /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/action => generated 0 bytes in 459 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:12:00.179494 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-cc67c218-e575-4045-b58a-e25594d8da99 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:00.180108 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-cc67c218-e575-4045-b58a-e25594d8da99 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:00.186615 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cc67c218-e575-4045-b58a-e25594d8da99 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:00.187135 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cc67c218-e575-4045-b58a-e25594d8da99 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:00.187578 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cc67c218-e575-4045-b58a-e25594d8da99 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:00.188279 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cc67c218-e575-4045-b58a-e25594d8da99 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:00.188742 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cc67c218-e575-4045-b58a-e25594d8da99 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:00.189173 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cc67c218-e575-4045-b58a-e25594d8da99 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:00.326372 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cc67c218-e575-4045-b58a-e25594d8da99 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:00.335081 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cc67c218-e575-4045-b58a-e25594d8da99 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:00.336545 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cc67c218-e575-4045-b58a-e25594d8da99 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:00.337717 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-cc67c218-e575-4045-b58a-e25594d8da99 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.162200 Sep 16 08:12:00.338297 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 406/857] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:00 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:01.364611 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0354c39c-3287-4529-929f-482eaa6fef78 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:01.365298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0354c39c-3287-4529-929f-482eaa6fef78 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:01.371522 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0354c39c-3287-4529-929f-482eaa6fef78 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:01.372008 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0354c39c-3287-4529-929f-482eaa6fef78 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:01.372440 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0354c39c-3287-4529-929f-482eaa6fef78 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:01.373122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0354c39c-3287-4529-929f-482eaa6fef78 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:01.373576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0354c39c-3287-4529-929f-482eaa6fef78 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:01.374004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0354c39c-3287-4529-929f-482eaa6fef78 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:01.480287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1d78237b-b26c-49a5-9672-60fdd302fd2f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:01.481466 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1d78237b-b26c-49a5-9672-60fdd302fd2f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:01.487989 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1d78237b-b26c-49a5-9672-60fdd302fd2f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:01.488813 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1d78237b-b26c-49a5-9672-60fdd302fd2f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:01.489253 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1d78237b-b26c-49a5-9672-60fdd302fd2f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:01.489954 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1d78237b-b26c-49a5-9672-60fdd302fd2f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:01.490708 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1d78237b-b26c-49a5-9672-60fdd302fd2f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:01.491327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1d78237b-b26c-49a5-9672-60fdd302fd2f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:01.506056 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-1d78237b-b26c-49a5-9672-60fdd302fd2f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] HTTP exception thrown: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1d78237b-b26c-49a5-9672-60fdd302fd2f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Request method failure captured: Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: DELETE /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 HTTP/1.1 Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5Hk4j_hjkfTYRalbAq7nKYw4un_VSdFpY9pPls5xpTZuPtwEbByuSCvNtEc66xwWeTjpgYOCh4UqNanlMOuJNnx-H_Lb5jOcR4Gk7-HtkwYrbz5YXG6rBjO6fKEjnfhzS6G30okaMCloyyOID1PArRtHdiRbl2kj-ouy60IMAUU74 Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 45838a0f741e485e8f424375c6d0d489 Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:12:01.507753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:12:01.509391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_45838a0f741e485e8f424375c6d0d489", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:01.509391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:12:01.509391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 45838a0f741e485e8f424375c6d0d489 Sep 16 08:12:01.509391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:12:01.509391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeTestJSON-1548693197-project Sep 16 08:12:01.509391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:12:01.509391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:12:01.509391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: 393fddf9c75447fab334b84694dcf4f1 Sep 16 08:12:01.509391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeTestJSON-1548693197-project Sep 16 08:12:01.509391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:12:01.509391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:12:01.509391 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '172d6ac8-f22f-4167-b9c2-4da9eef51e88'} Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:01.510450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:12:01.511970 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:01.514131 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1d78237b-b26c-49a5-9672-60fdd302fd2f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Returning 404 to user: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:01.515014 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1d78237b-b26c-49a5-9672-60fdd302fd2f tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "DELETE /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 404 len: 111 microversion: 2.1 time: 0.039014 Sep 16 08:12:01.515746 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 407/858] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:12:01 2022] DELETE /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 111 bytes in 40 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 08:12:01.520732 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0354c39c-3287-4529-929f-482eaa6fef78 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:01.524285 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0e5c085d-8438-4a21-ab50-54c9da8bb2ed tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:01.524900 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0e5c085d-8438-4a21-ab50-54c9da8bb2ed tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: 172d6ac8-f22f-4167-b9c2-4da9eef51e88] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:01.529562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0354c39c-3287-4529-929f-482eaa6fef78 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:01.531034 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0354c39c-3287-4529-929f-482eaa6fef78 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:01.531393 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0e5c085d-8438-4a21-ab50-54c9da8bb2ed tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:01.531880 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0e5c085d-8438-4a21-ab50-54c9da8bb2ed tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:01.532240 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0354c39c-3287-4529-929f-482eaa6fef78 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.172388 Sep 16 08:12:01.532376 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0e5c085d-8438-4a21-ab50-54c9da8bb2ed tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:01.532806 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 452/859] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:01 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:12:01.532987 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0e5c085d-8438-4a21-ab50-54c9da8bb2ed tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:01.533495 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0e5c085d-8438-4a21-ab50-54c9da8bb2ed tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:01.533921 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0e5c085d-8438-4a21-ab50-54c9da8bb2ed tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:01.547750 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-0e5c085d-8438-4a21-ab50-54c9da8bb2ed tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] HTTP exception thrown: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0e5c085d-8438-4a21-ab50-54c9da8bb2ed tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Request method failure captured: Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 HTTP/1.1 Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5Hk4j_hjkfTYRalbAq7nKYw4un_VSdFpY9pPls5xpTZuPtwEbByuSCvNtEc66xwWeTjpgYOCh4UqNanlMOuJNnx-H_Lb5jOcR4Gk7-HtkwYrbz5YXG6rBjO6fKEjnfhzS6G30okaMCloyyOID1PArRtHdiRbl2kj-ouy60IMAUU74 Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 45838a0f741e485e8f424375c6d0d489 Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:12:01.549460 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:12:01.551114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_45838a0f741e485e8f424375c6d0d489", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:01.551114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:12:01.551114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 45838a0f741e485e8f424375c6d0d489 Sep 16 08:12:01.551114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:12:01.551114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeTestJSON-1548693197-project Sep 16 08:12:01.551114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:12:01.551114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:12:01.551114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: 393fddf9c75447fab334b84694dcf4f1 Sep 16 08:12:01.551114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeTestJSON-1548693197-project Sep 16 08:12:01.551114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:12:01.551114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:12:01.551114 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '172d6ac8-f22f-4167-b9c2-4da9eef51e88'} Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:01.552030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. Sep 16 08:12:01.553560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:01.554897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0e5c085d-8438-4a21-ab50-54c9da8bb2ed tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Returning 404 to user: Instance 172d6ac8-f22f-4167-b9c2-4da9eef51e88 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:01.554897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0e5c085d-8438-4a21-ab50-54c9da8bb2ed tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88" status: 404 len: 111 microversion: 2.1 time: 0.030428 Sep 16 08:12:01.554897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 408/860] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:01 2022] GET /compute/v2.1/servers/172d6ac8-f22f-4167-b9c2-4da9eef51e88 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 08:12:02.562521 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-31aa98ea-26c1-4fe6-92f0-e48823111532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:02.563166 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-31aa98ea-26c1-4fe6-92f0-e48823111532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:02.569664 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31aa98ea-26c1-4fe6-92f0-e48823111532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:02.570174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31aa98ea-26c1-4fe6-92f0-e48823111532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:02.570600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31aa98ea-26c1-4fe6-92f0-e48823111532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:02.571338 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31aa98ea-26c1-4fe6-92f0-e48823111532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:02.571789 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31aa98ea-26c1-4fe6-92f0-e48823111532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:02.572221 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31aa98ea-26c1-4fe6-92f0-e48823111532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:02.704885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-31aa98ea-26c1-4fe6-92f0-e48823111532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:02.713540 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-31aa98ea-26c1-4fe6-92f0-e48823111532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:02.715009 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-31aa98ea-26c1-4fe6-92f0-e48823111532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:02.716171 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-31aa98ea-26c1-4fe6-92f0-e48823111532 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.157561 Sep 16 08:12:02.730894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 453/861] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:02 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:02.805498 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-20f9a9fa-4658-4c27-a10a-6b9336ee07f0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:02.805998 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-20f9a9fa-4658-4c27-a10a-6b9336ee07f0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:02.812494 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-20f9a9fa-4658-4c27-a10a-6b9336ee07f0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:02.812979 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-20f9a9fa-4658-4c27-a10a-6b9336ee07f0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:02.813418 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-20f9a9fa-4658-4c27-a10a-6b9336ee07f0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:02.814115 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-20f9a9fa-4658-4c27-a10a-6b9336ee07f0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:02.815094 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-20f9a9fa-4658-4c27-a10a-6b9336ee07f0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:02.815524 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-20f9a9fa-4658-4c27-a10a-6b9336ee07f0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:02.828627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-20f9a9fa-4658-4c27-a10a-6b9336ee07f0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] HTTP exception thrown: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-20f9a9fa-4658-4c27-a10a-6b9336ee07f0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Request method failure captured: Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: DELETE /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 HTTP/1.1 Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5Hk4j_hjkfTYRalbAq7nKYw4un_VSdFpY9pPls5xpTZuPtwEbByuSCvNtEc66xwWeTjpgYOCh4UqNanlMOuJNnx-H_Lb5jOcR4Gk7-HtkwYrbz5YXG6rBjO6fKEjnfhzS6G30okaMCloyyOID1PArRtHdiRbl2kj-ouy60IMAUU74 Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 45838a0f741e485e8f424375c6d0d489 Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:12:02.830860 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:12:02.832593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_45838a0f741e485e8f424375c6d0d489", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:02.832593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:12:02.832593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 45838a0f741e485e8f424375c6d0d489 Sep 16 08:12:02.832593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:12:02.832593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeTestJSON-1548693197-project Sep 16 08:12:02.832593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:12:02.832593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:12:02.832593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: 393fddf9c75447fab334b84694dcf4f1 Sep 16 08:12:02.832593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeTestJSON-1548693197-project Sep 16 08:12:02.832593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:12:02.832593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:12:02.832593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': 'fe69a551-c89a-4b4f-a026-5e23f39a1355'} Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:02.833377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:12:02.834616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:02.835985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-20f9a9fa-4658-4c27-a10a-6b9336ee07f0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Returning 404 to user: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:02.835985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-20f9a9fa-4658-4c27-a10a-6b9336ee07f0 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 404 len: 111 microversion: 2.1 time: 0.030582 Sep 16 08:12:02.835985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 409/862] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:12:02 2022] DELETE /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:12:02.840679 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-df0873ff-f93a-472c-b80a-e04026badd16 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:02.841301 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-df0873ff-f93a-472c-b80a-e04026badd16 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] [instance: fe69a551-c89a-4b4f-a026-5e23f39a1355] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:02.847348 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-df0873ff-f93a-472c-b80a-e04026badd16 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:02.847843 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-df0873ff-f93a-472c-b80a-e04026badd16 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:02.848287 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-df0873ff-f93a-472c-b80a-e04026badd16 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:02.848992 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-df0873ff-f93a-472c-b80a-e04026badd16 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:02.849461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-df0873ff-f93a-472c-b80a-e04026badd16 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:02.849894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-df0873ff-f93a-472c-b80a-e04026badd16 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:02.862878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-df0873ff-f93a-472c-b80a-e04026badd16 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] HTTP exception thrown: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-df0873ff-f93a-472c-b80a-e04026badd16 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Request method failure captured: Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 HTTP/1.1 Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5Hk4j_hjkfTYRalbAq7nKYw4un_VSdFpY9pPls5xpTZuPtwEbByuSCvNtEc66xwWeTjpgYOCh4UqNanlMOuJNnx-H_Lb5jOcR4Gk7-HtkwYrbz5YXG6rBjO6fKEjnfhzS6G30okaMCloyyOID1PArRtHdiRbl2kj-ouy60IMAUU74 Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 45838a0f741e485e8f424375c6d0d489 Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:12:02.864506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:12:02.866053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_45838a0f741e485e8f424375c6d0d489", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/45838a0f741e485e8f424375c6d0d489"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:02.866053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:12:02.866053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 45838a0f741e485e8f424375c6d0d489 Sep 16 08:12:02.866053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-AttachVolumeTestJSON-1548693197 Sep 16 08:12:02.866053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-AttachVolumeTestJSON-1548693197-project Sep 16 08:12:02.866053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:12:02.866053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:12:02.866053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: 393fddf9c75447fab334b84694dcf4f1 Sep 16 08:12:02.866053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-AttachVolumeTestJSON-1548693197-project Sep 16 08:12:02.866053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:12:02.866053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:12:02.866053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': 'fe69a551-c89a-4b4f-a026-5e23f39a1355'} Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:02.870216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. Sep 16 08:12:02.872257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:02.873603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-df0873ff-f93a-472c-b80a-e04026badd16 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] Returning 404 to user: Instance fe69a551-c89a-4b4f-a026-5e23f39a1355 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:02.873603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-df0873ff-f93a-472c-b80a-e04026badd16 tempest-AttachVolumeTestJSON-1548693197 tempest-AttachVolumeTestJSON-1548693197-project] 10.222.0.59 "GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355" status: 404 len: 111 microversion: 2.1 time: 0.029175 Sep 16 08:12:02.873603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 454/863] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:02 2022] GET /compute/v2.1/servers/fe69a551-c89a-4b4f-a026-5e23f39a1355 => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 08:12:03.743555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-649703dd-f769-4394-97bd-431e8943b179 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:03.744380 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-649703dd-f769-4394-97bd-431e8943b179 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:03.750431 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-649703dd-f769-4394-97bd-431e8943b179 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:03.751194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-649703dd-f769-4394-97bd-431e8943b179 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:03.751630 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-649703dd-f769-4394-97bd-431e8943b179 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:03.752841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-649703dd-f769-4394-97bd-431e8943b179 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:03.753539 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-649703dd-f769-4394-97bd-431e8943b179 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:03.754041 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-649703dd-f769-4394-97bd-431e8943b179 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:03.898180 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-649703dd-f769-4394-97bd-431e8943b179 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:03.906606 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-649703dd-f769-4394-97bd-431e8943b179 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:03.908474 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-649703dd-f769-4394-97bd-431e8943b179 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:03.909692 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-649703dd-f769-4394-97bd-431e8943b179 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.171414 Sep 16 08:12:03.910263 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 410/864] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:03 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:12:04.935010 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dd593f27-5b5c-43b1-9fef-4d62926eb6a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:04.935850 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dd593f27-5b5c-43b1-9fef-4d62926eb6a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:04.942994 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd593f27-5b5c-43b1-9fef-4d62926eb6a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:04.943483 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd593f27-5b5c-43b1-9fef-4d62926eb6a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:04.943925 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd593f27-5b5c-43b1-9fef-4d62926eb6a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:04.944640 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd593f27-5b5c-43b1-9fef-4d62926eb6a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:04.945153 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd593f27-5b5c-43b1-9fef-4d62926eb6a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:04.945579 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd593f27-5b5c-43b1-9fef-4d62926eb6a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:05.111090 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dd593f27-5b5c-43b1-9fef-4d62926eb6a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:05.124366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dd593f27-5b5c-43b1-9fef-4d62926eb6a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:05.126481 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dd593f27-5b5c-43b1-9fef-4d62926eb6a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:05.128164 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dd593f27-5b5c-43b1-9fef-4d62926eb6a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.197163 Sep 16 08:12:05.129669 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 455/865] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:04 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:06.157855 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0753342e-ce4c-4298-93eb-c8324b9cffe1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:06.159358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0753342e-ce4c-4298-93eb-c8324b9cffe1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:06.166639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0753342e-ce4c-4298-93eb-c8324b9cffe1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:06.167285 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0753342e-ce4c-4298-93eb-c8324b9cffe1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:06.167823 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0753342e-ce4c-4298-93eb-c8324b9cffe1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:06.168886 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0753342e-ce4c-4298-93eb-c8324b9cffe1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:06.169863 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0753342e-ce4c-4298-93eb-c8324b9cffe1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:06.173117 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0753342e-ce4c-4298-93eb-c8324b9cffe1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:06.371256 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0753342e-ce4c-4298-93eb-c8324b9cffe1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:06.380567 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0753342e-ce4c-4298-93eb-c8324b9cffe1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:06.382091 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0753342e-ce4c-4298-93eb-c8324b9cffe1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:06.383297 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0753342e-ce4c-4298-93eb-c8324b9cffe1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.233582 Sep 16 08:12:06.384033 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 411/866] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:06 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 235 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:07.408566 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1af12803-4dab-4680-b261-8d0aa2a1181d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:07.409114 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1af12803-4dab-4680-b261-8d0aa2a1181d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:07.416187 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1af12803-4dab-4680-b261-8d0aa2a1181d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:07.422458 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1af12803-4dab-4680-b261-8d0aa2a1181d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:07.422458 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1af12803-4dab-4680-b261-8d0aa2a1181d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:07.422458 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1af12803-4dab-4680-b261-8d0aa2a1181d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:07.422458 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1af12803-4dab-4680-b261-8d0aa2a1181d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:07.422856 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1af12803-4dab-4680-b261-8d0aa2a1181d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:07.590463 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1af12803-4dab-4680-b261-8d0aa2a1181d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:07.602322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1af12803-4dab-4680-b261-8d0aa2a1181d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:07.603858 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1af12803-4dab-4680-b261-8d0aa2a1181d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:07.605057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1af12803-4dab-4680-b261-8d0aa2a1181d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.200845 Sep 16 08:12:07.615413 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 456/867] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:07 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:08.630090 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e44f1b0a-2487-44bb-b408-a4fe6d8ec8cb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:08.630743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e44f1b0a-2487-44bb-b408-a4fe6d8ec8cb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:08.637540 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e44f1b0a-2487-44bb-b408-a4fe6d8ec8cb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:08.638011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e44f1b0a-2487-44bb-b408-a4fe6d8ec8cb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:08.638448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e44f1b0a-2487-44bb-b408-a4fe6d8ec8cb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:08.639419 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e44f1b0a-2487-44bb-b408-a4fe6d8ec8cb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:08.640117 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e44f1b0a-2487-44bb-b408-a4fe6d8ec8cb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:08.640541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e44f1b0a-2487-44bb-b408-a4fe6d8ec8cb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:08.718450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-8a4546f6-8f59-4348-8a3f-c3b78d0ecabd tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] Action: 'create', calling method: .version_select at 0x7f9d068f33a0>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesGetTestJSON-Volume-1882363500", "metadata": {"Type": "work"}}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:08.785111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e44f1b0a-2487-44bb-b408-a4fe6d8ec8cb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:08.793737 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e44f1b0a-2487-44bb-b408-a4fe6d8ec8cb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:08.795203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e44f1b0a-2487-44bb-b408-a4fe6d8ec8cb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:08.796414 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e44f1b0a-2487-44bb-b408-a4fe6d8ec8cb tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.170320 Sep 16 08:12:08.796980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 457/868] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:08 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:12:09.282297 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-8a4546f6-8f59-4348-8a3f-c3b78d0ecabd tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 353 microversion: 2.1 time: 0.691037 Sep 16 08:12:09.282972 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 412/869] 10.222.0.59 () {60 vars in 1156 bytes} [Fri Sep 16 08:12:08 2022] POST /compute/v2.1/os-volumes => generated 353 bytes in 692 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 16 08:12:09.295764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-02f5b21d-665e-4966-82da-b81544745aa8 tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] Calling method '.version_select at 0x7f9d069df550>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:09.347179 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-02f5b21d-665e-4966-82da-b81544745aa8 tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88" status: 200 len: 353 microversion: 2.1 time: 0.055158 Sep 16 08:12:09.347675 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 458/870] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:12:09 2022] GET /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88 => generated 353 bytes in 56 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:09.822534 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-65c3f531-da44-4709-857a-2365c15f4001 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:09.823131 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-65c3f531-da44-4709-857a-2365c15f4001 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:09.832529 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-65c3f531-da44-4709-857a-2365c15f4001 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:09.833012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-65c3f531-da44-4709-857a-2365c15f4001 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:09.833446 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-65c3f531-da44-4709-857a-2365c15f4001 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:09.834167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-65c3f531-da44-4709-857a-2365c15f4001 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:09.834593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-65c3f531-da44-4709-857a-2365c15f4001 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:09.835045 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-65c3f531-da44-4709-857a-2365c15f4001 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:09.969286 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-65c3f531-da44-4709-857a-2365c15f4001 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:09.977692 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-65c3f531-da44-4709-857a-2365c15f4001 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:09.979269 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-65c3f531-da44-4709-857a-2365c15f4001 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:09.980488 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-65c3f531-da44-4709-857a-2365c15f4001 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.162427 Sep 16 08:12:09.981025 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 413/871] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:09 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:10.362040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b48b116f-f53a-4b9d-83cb-b7439e084c03 tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] Calling method '.version_select at 0x7f9d069da430>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:10.410064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b48b116f-f53a-4b9d-83cb-b7439e084c03 tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88" status: 200 len: 354 microversion: 2.1 time: 0.051969 Sep 16 08:12:10.410651 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 459/872] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:12:10 2022] GET /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88 => generated 354 bytes in 54 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:10.423799 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3be1c846-7e3b-4509-b63e-2ee5fd3fd8da tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] Calling method '.version_select at 0x7f9d06a50a60>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:10.471026 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3be1c846-7e3b-4509-b63e-2ee5fd3fd8da tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88" status: 200 len: 354 microversion: 2.1 time: 0.051014 Sep 16 08:12:10.472224 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 414/873] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:12:10 2022] GET /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88 => generated 354 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:10.485199 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-70f1e593-5600-4e24-ab14-dd3233eb80df tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] Calling method '.version_select at 0x7f9d069b2820>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:10.709185 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-70f1e593-5600-4e24-ab14-dd3233eb80df tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88" status: 202 len: 0 microversion: 2.1 time: 0.227622 Sep 16 08:12:10.709782 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 460/874] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Sep 16 08:12:10 2022] DELETE /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88 => generated 0 bytes in 229 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:12:10.718019 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-01e11d84-39a8-4fb2-82b6-2971b5f69495 tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] Calling method '.version_select at 0x7f9d06ae9ee0>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:10.764729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-01e11d84-39a8-4fb2-82b6-2971b5f69495 tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88" status: 200 len: 353 microversion: 2.1 time: 0.050802 Sep 16 08:12:10.765291 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 415/875] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:12:10 2022] GET /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88 => generated 353 bytes in 52 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:11.007020 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b8b9c19a-71f3-47db-a729-f4dbfb3762e8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:11.007650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b8b9c19a-71f3-47db-a729-f4dbfb3762e8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:11.013834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b8b9c19a-71f3-47db-a729-f4dbfb3762e8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:11.014369 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b8b9c19a-71f3-47db-a729-f4dbfb3762e8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:11.014852 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b8b9c19a-71f3-47db-a729-f4dbfb3762e8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:11.015656 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b8b9c19a-71f3-47db-a729-f4dbfb3762e8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:11.016122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b8b9c19a-71f3-47db-a729-f4dbfb3762e8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:11.016572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b8b9c19a-71f3-47db-a729-f4dbfb3762e8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:11.147206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b8b9c19a-71f3-47db-a729-f4dbfb3762e8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:11.155426 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b8b9c19a-71f3-47db-a729-f4dbfb3762e8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:11.160343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b8b9c19a-71f3-47db-a729-f4dbfb3762e8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:11.160343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b8b9c19a-71f3-47db-a729-f4dbfb3762e8 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.155521 Sep 16 08:12:11.160343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 461/876] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:11 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:11.780448 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a0a131ca-1863-44c1-bda2-0b55bf88e646 tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] Calling method '.version_select at 0x7f9d067b5040>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:11.810380 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-a0a131ca-1863-44c1-bda2-0b55bf88e646 tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] HTTP exception thrown: Volume ebd68c75-6df9-4b11-89f4-d6c8e6341e88 could not be found. Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a0a131ca-1863-44c1-bda2-0b55bf88e646 tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] Request method failure captured: Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88 HTTP/1.1 Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC_YISEHINB3zWPthEKJRC-PhW-gC7myUYSUbKqjfc-v-Cvxpc-SQlheFUQqhQgh2Zwfn1QWdqVQVWLEVRvrLoguq8Pu17u7SdJ9A_JKC5Fd3BQb3pwYjvl8UWE4EQcXvHPXDj7zk7WM9VnMBT_CP4-jRyys7yLyZVbeShAUmoJ6V-Y Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: a6e1d253ff8041ecbb96a3cba86b17a6 Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-VolumesGetTestJSON-1439626702 Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:12:11.813955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a6e1d253ff8041ecbb96a3cba86b17a6"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/a6e1d253ff8041ecbb96a3cba86b17a6"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_a6e1d253ff8041ecbb96a3cba86b17a6", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/a6e1d253ff8041ecbb96a3cba86b17a6"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-VolumesGetTestJSON-1439626702 Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: a6e1d253ff8041ecbb96a3cba86b17a6 Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-VolumesGetTestJSON-1439626702 Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-VolumesGetTestJSON-1439626702-project Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: 291d4784a1ac4762b3247f277b1f7ec0 Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-VolumesGetTestJSON-1439626702-project Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Volume ebd68c75-6df9-4b11-89f4-d6c8e6341e88 could not be found. Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': 'ebd68c75-6df9-4b11-89f4-d6c8e6341e88'} Sep 16 08:12:11.816220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume ebd68c75-6df9-4b11-89f4-d6c8e6341e88 could not be found. (HTTP 404) (Request-ID: req-d8d00eda-05da-4c0c-9073-893736ef61aa) Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:11.817150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 08:12:11.818523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume ebd68c75-6df9-4b11-89f4-d6c8e6341e88 could not be found. Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 08:12:11.819929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume ebd68c75-6df9-4b11-89f4-d6c8e6341e88 could not be found. Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume ebd68c75-6df9-4b11-89f4-d6c8e6341e88 could not be found. Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a0a131ca-1863-44c1-bda2-0b55bf88e646 tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] Returning 404 to user: Volume ebd68c75-6df9-4b11-89f4-d6c8e6341e88 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a0a131ca-1863-44c1-bda2-0b55bf88e646 tempest-VolumesGetTestJSON-1439626702 tempest-VolumesGetTestJSON-1439626702-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88" status: 404 len: 109 microversion: 2.1 time: 0.039714 Sep 16 08:12:11.821318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 416/877] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:12:11 2022] GET /compute/v2.1/os-volumes/ebd68c75-6df9-4b11-89f4-d6c8e6341e88 => generated 109 bytes in 42 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:12:11.825824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1568c058-7b3b-4741-9ff5-a00cf0a42e6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:11.826397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1568c058-7b3b-4741-9ff5-a00cf0a42e6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:11.833336 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1568c058-7b3b-4741-9ff5-a00cf0a42e6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:11.833894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1568c058-7b3b-4741-9ff5-a00cf0a42e6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:11.834535 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1568c058-7b3b-4741-9ff5-a00cf0a42e6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:11.835271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1568c058-7b3b-4741-9ff5-a00cf0a42e6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:11.835734 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1568c058-7b3b-4741-9ff5-a00cf0a42e6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:11.836161 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1568c058-7b3b-4741-9ff5-a00cf0a42e6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:11.860264 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1568c058-7b3b-4741-9ff5-a00cf0a42e6f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/ips" status: 200 len: 149 microversion: 2.1 time: 0.040650 Sep 16 08:12:11.860845 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 462/878] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Sep 16 08:12:11 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/ips => generated 149 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:12.183745 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2470f8ad-7547-4e7b-aa1f-6c0236682a11 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:12.184358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2470f8ad-7547-4e7b-aa1f-6c0236682a11 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:12.191776 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2470f8ad-7547-4e7b-aa1f-6c0236682a11 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:12.192270 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2470f8ad-7547-4e7b-aa1f-6c0236682a11 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:12.192704 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2470f8ad-7547-4e7b-aa1f-6c0236682a11 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:12.193404 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2470f8ad-7547-4e7b-aa1f-6c0236682a11 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:12.193857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2470f8ad-7547-4e7b-aa1f-6c0236682a11 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:12.194500 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2470f8ad-7547-4e7b-aa1f-6c0236682a11 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:12.344246 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2470f8ad-7547-4e7b-aa1f-6c0236682a11 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:12.356183 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2470f8ad-7547-4e7b-aa1f-6c0236682a11 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:12.358903 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2470f8ad-7547-4e7b-aa1f-6c0236682a11 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:12.361032 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2470f8ad-7547-4e7b-aa1f-6c0236682a11 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.180839 Sep 16 08:12:12.361278 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 417/879] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:12 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:13.387048 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-77ae1abd-e1b8-46fd-bb73-a352d575df4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:13.388198 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-77ae1abd-e1b8-46fd-bb73-a352d575df4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:13.398208 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77ae1abd-e1b8-46fd-bb73-a352d575df4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:13.398208 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77ae1abd-e1b8-46fd-bb73-a352d575df4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:13.398932 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77ae1abd-e1b8-46fd-bb73-a352d575df4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:13.400127 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77ae1abd-e1b8-46fd-bb73-a352d575df4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:13.400955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77ae1abd-e1b8-46fd-bb73-a352d575df4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:13.401898 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-77ae1abd-e1b8-46fd-bb73-a352d575df4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:13.472530 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-cd4bab5f-6248-4f00-a529-da0e48885c00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "5f22a683-05a9-4f26-93da-0245a7e8d394"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:13.478187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-cd4bab5f-6248-4f00-a529-da0e48885c00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:13.491240 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cd4bab5f-6248-4f00-a529-da0e48885c00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:13.491814 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cd4bab5f-6248-4f00-a529-da0e48885c00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:13.492333 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cd4bab5f-6248-4f00-a529-da0e48885c00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:13.493117 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cd4bab5f-6248-4f00-a529-da0e48885c00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:13.493836 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cd4bab5f-6248-4f00-a529-da0e48885c00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:13.494619 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cd4bab5f-6248-4f00-a529-da0e48885c00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:13.567870 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-77ae1abd-e1b8-46fd-bb73-a352d575df4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:13.577171 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-77ae1abd-e1b8-46fd-bb73-a352d575df4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:13.578980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-77ae1abd-e1b8-46fd-bb73-a352d575df4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:13.579996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-77ae1abd-e1b8-46fd-bb73-a352d575df4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.198062 Sep 16 08:12:13.581396 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 463/880] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:13 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:13.938584 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-fea7aa70-1815-4ef4-97de-1cca71900324 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Action: 'create', calling method: .version_select at 0x7f9d069b25e0>, body: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-646057648", "metadata": {"Type": "work"}}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-fea7aa70-1815-4ef4-97de-1cca71900324 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Request method failure captured: Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 121 Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC_dxYTS-u6jUTP7ioYk_8LNjKpusku33DHSC9qr0qbNAIk4TLCEfHwIPeKY3YoAUUcTgVgyd7uXib60RLU-0btI3DCiur2FrmcqDPan6rGYVmmTP-uzINJkE2Adx9uzqaakBV_nMMujWQx3KX8t_jh8x198wIih6FZudPTNQ6iIH6A Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: b4dd748a933e4c24a85624347d2586fd Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:12:13.947262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4dd748a933e4c24a85624347d2586fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: b4dd748a933e4c24a85624347d2586fd Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-VolumesNegativeTest-487116008-project Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: c8ca0777c691427e8249dbb3a69e17a3 Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-VolumesNegativeTest-487116008-project Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {"volume": {"size": "#$%", "display_name": "tempest-VolumesNegativeTest-Volume-646057648", "metadata": {"Type": "work"}}} Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: Sep 16 08:12:13.949110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'body': {'volume': {'size': '#$%', 'display_name': 'tempest-VolumesNegativeTest-Volume-646057648', 'metadata': {'Type': 'work'}}}} Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise error Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '#$%' does not match '^[0-9]+$' Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi '#$%' Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:13.950300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 08:12:13.952017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 08:12:13.953876 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' Sep 16 08:12:13.953876 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.953876 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-fea7aa70-1815-4ef4-97de-1cca71900324 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Returning 400 to user: Invalid input for field/attribute size. Value: #$%. '#$%' does not match '^[0-9]+$' {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:13.953876 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-fea7aa70-1815-4ef4-97de-1cca71900324 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 127 microversion: 2.1 time: 0.137806 Sep 16 08:12:13.953876 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 464/881] 10.222.0.59 () {60 vars in 1156 bytes} [Fri Sep 16 08:12:13 2022] POST /compute/v2.1/os-volumes => generated 127 bytes in 139 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 16 08:12:13.958378 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6bc1ec3e-118e-47c0-a429-721966b71303 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Action: 'create', calling method: .version_select at 0x7f9d06aa6f70>, body: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1052443055", "metadata": {"Type": "work"}}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6bc1ec3e-118e-47c0-a429-721966b71303 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Request method failure captured: Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 120 Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC_dxYTS-u6jUTP7ioYk_8LNjKpusku33DHSC9qr0qbNAIk4TLCEfHwIPeKY3YoAUUcTgVgyd7uXib60RLU-0btI3DCiur2FrmcqDPan6rGYVmmTP-uzINJkE2Adx9uzqaakBV_nMMujWQx3KX8t_jh8x198wIih6FZudPTNQ6iIH6A Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: b4dd748a933e4c24a85624347d2586fd Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:12:13.962207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4dd748a933e4c24a85624347d2586fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: b4dd748a933e4c24a85624347d2586fd Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-VolumesNegativeTest-487116008-project Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: c8ca0777c691427e8249dbb3a69e17a3 Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-VolumesNegativeTest-487116008-project Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {"volume": {"size": "0", "display_name": "tempest-VolumesNegativeTest-Volume-1052443055", "metadata": {"Type": "work"}}} Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: Sep 16 08:12:13.966818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'body': {'volume': {'size': '0', 'display_name': 'tempest-VolumesNegativeTest-Volume-1052443055', 'metadata': {'Type': 'work'}}}} Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise error Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: 0 is less than the minimum of 1 Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Failed validating 'minimum' in schema['properties']['volume']['properties']['size']: Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi '0' Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:13.967760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 08:12:13.969422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 08:12:13.970809 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 Sep 16 08:12:13.970809 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.970809 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6bc1ec3e-118e-47c0-a429-721966b71303 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Returning 400 to user: Invalid input for field/attribute size. Value: 0. 0 is less than the minimum of 1 {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:13.970809 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6bc1ec3e-118e-47c0-a429-721966b71303 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 125 microversion: 2.1 time: 0.009063 Sep 16 08:12:13.970809 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 465/882] 10.222.0.59 () {60 vars in 1156 bytes} [Fri Sep 16 08:12:13 2022] POST /compute/v2.1/os-volumes => generated 125 bytes in 10 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 16 08:12:13.974590 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e46d4c2e-fcdc-4e09-afa0-970f0a54a36d tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Action: 'create', calling method: .version_select at 0x7f9d06a69280>, body: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-798791123", "metadata": {"Type": "work"}}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e46d4c2e-fcdc-4e09-afa0-970f0a54a36d tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Request method failure captured: Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: POST /compute/v2.1/os-volumes HTTP/1.1 Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 118 Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC_dxYTS-u6jUTP7ioYk_8LNjKpusku33DHSC9qr0qbNAIk4TLCEfHwIPeKY3YoAUUcTgVgyd7uXib60RLU-0btI3DCiur2FrmcqDPan6rGYVmmTP-uzINJkE2Adx9uzqaakBV_nMMujWQx3KX8t_jh8x198wIih6FZudPTNQ6iIH6A Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: b4dd748a933e4c24a85624347d2586fd Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:12:13.978261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4dd748a933e4c24a85624347d2586fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: b4dd748a933e4c24a85624347d2586fd Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-VolumesNegativeTest-487116008-project Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: c8ca0777c691427e8249dbb3a69e17a3 Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-VolumesNegativeTest-487116008-project Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {"volume": {"size": "", "display_name": "tempest-VolumesNegativeTest-Volume-798791123", "metadata": {"Type": "work"}}} Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: Sep 16 08:12:13.979878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'body': {'volume': {'size': '', 'display_name': 'tempest-VolumesNegativeTest-Volume-798791123', 'metadata': {'Type': 'work'}}}} Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 302, in validate Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi self.validator.validate(*args, **kwargs) Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/jsonschema/validators.py", line 303, in validate Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise error Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi jsonschema.exceptions.ValidationError: '' does not match '^[0-9]+$' Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Failed validating 'pattern' in schema['properties']['volume']['properties']['size']: Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi {'minimum': 1, 'pattern': '^[0-9]+$', 'type': ['integer', 'string']} Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi On instance['volume']: Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi '' Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:13.980824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 107, in wrapper Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi _schema_validation_helper(request_body_schema, kwargs['body'], Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/__init__.py", line 88, in _schema_validation_helper Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi schema_validator.validate(target) Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/validation/validators.py", line 331, in validate Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.ValidationError(detail=detail) Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.ValidationError: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 359, in __exit__ Sep 16 08:12:13.982442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(exception.ConvertedException( Sep 16 08:12:13.983795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' Sep 16 08:12:13.983795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:13.983795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e46d4c2e-fcdc-4e09-afa0-970f0a54a36d tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Returning 400 to user: Invalid input for field/attribute size. Value: . '' does not match '^[0-9]+$' {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:13.983795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e46d4c2e-fcdc-4e09-afa0-970f0a54a36d tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 400 len: 121 microversion: 2.1 time: 0.009215 Sep 16 08:12:13.984327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 466/883] 10.222.0.59 () {60 vars in 1156 bytes} [Fri Sep 16 08:12:13 2022] POST /compute/v2.1/os-volumes => generated 121 bytes in 16 msecs (HTTP/1.1 400) 9 headers in 381 bytes (2 switches on core 0) Sep 16 08:12:13.989653 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-37932969-09f9-49a5-87e0-5a9b1b065090 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Calling method '.version_select at 0x7f9d069b2790>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:14.018503 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-37932969-09f9-49a5-87e0-5a9b1b065090 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] HTTP exception thrown: Volume tempest-invalid-1149156268 could not be found. Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-37932969-09f9-49a5-87e0-5a9b1b065090 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Request method failure captured: Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: DELETE /compute/v2.1/os-volumes/tempest-invalid-1149156268 HTTP/1.1 Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC_dxYTS-u6jUTP7ioYk_8LNjKpusku33DHSC9qr0qbNAIk4TLCEfHwIPeKY3YoAUUcTgVgyd7uXib60RLU-0btI3DCiur2FrmcqDPan6rGYVmmTP-uzINJkE2Adx9uzqaakBV_nMMujWQx3KX8t_jh8x198wIih6FZudPTNQ6iIH6A Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: b4dd748a933e4c24a85624347d2586fd Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:12:14.021896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4dd748a933e4c24a85624347d2586fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: b4dd748a933e4c24a85624347d2586fd Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-VolumesNegativeTest-487116008-project Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: c8ca0777c691427e8249dbb3a69e17a3 Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-VolumesNegativeTest-487116008-project Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Volume tempest-invalid-1149156268 could not be found. Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': 'tempest-invalid-1149156268'} Sep 16 08:12:14.027064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume tempest-invalid-1149156268 could not be found. (HTTP 404) (Request-ID: req-fdf256c3-0a74-4f2c-81f4-88ae273cd544) Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:14.027985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 08:12:14.029657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume tempest-invalid-1149156268 could not be found. Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:14.031058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume tempest-invalid-1149156268 could not be found. Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume tempest-invalid-1149156268 could not be found. Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-37932969-09f9-49a5-87e0-5a9b1b065090 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Returning 404 to user: Volume tempest-invalid-1149156268 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-37932969-09f9-49a5-87e0-5a9b1b065090 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/tempest-invalid-1149156268" status: 404 len: 99 microversion: 2.1 time: 0.037849 Sep 16 08:12:14.032519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 467/884] 10.222.0.59 () {58 vars in 1218 bytes} [Fri Sep 16 08:12:13 2022] DELETE /compute/v2.1/os-volumes/tempest-invalid-1149156268 => generated 99 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 378 bytes (2 switches on core 0) Sep 16 08:12:14.036828 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-007fcc1c-d49c-4233-ae6d-3c69f87ccf71 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.004990 Sep 16 08:12:14.037393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 468/885] 10.222.0.59 () {58 vars in 1140 bytes} [Fri Sep 16 08:12:14 2022] DELETE /compute/v2.1/os-volumes/ => generated 112 bytes in 6 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 08:12:14.045847 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-42877ea5-4517-45c7-b55c-f22cda6ebf63 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/" status: 404 len: 112 microversion: - time: 0.003650 Sep 16 08:12:14.046344 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 469/886] 10.222.0.59 () {58 vars in 1137 bytes} [Fri Sep 16 08:12:14 2022] GET /compute/v2.1/os-volumes/ => generated 112 bytes in 5 msecs (HTTP/1.1 404) 5 headers in 228 bytes (1 switches on core 0) Sep 16 08:12:14.055386 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9cb8b2dc-6bfc-4053-9b30-025af7d1e375 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Calling method '.version_select at 0x7f9d069b2ee0>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:14.083423 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-9cb8b2dc-6bfc-4053-9b30-025af7d1e375 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] HTTP exception thrown: Volume 3af68c35-9fc2-45b2-b943-4260fd8d6cff could not be found. Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9cb8b2dc-6bfc-4053-9b30-025af7d1e375 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Request method failure captured: Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: DELETE /compute/v2.1/os-volumes/3af68c35-9fc2-45b2-b943-4260fd8d6cff HTTP/1.1 Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC_dxYTS-u6jUTP7ioYk_8LNjKpusku33DHSC9qr0qbNAIk4TLCEfHwIPeKY3YoAUUcTgVgyd7uXib60RLU-0btI3DCiur2FrmcqDPan6rGYVmmTP-uzINJkE2Adx9uzqaakBV_nMMujWQx3KX8t_jh8x198wIih6FZudPTNQ6iIH6A Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: b4dd748a933e4c24a85624347d2586fd Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:12:14.085416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4dd748a933e4c24a85624347d2586fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: b4dd748a933e4c24a85624347d2586fd Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-VolumesNegativeTest-487116008-project Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: c8ca0777c691427e8249dbb3a69e17a3 Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-VolumesNegativeTest-487116008-project Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Volume 3af68c35-9fc2-45b2-b943-4260fd8d6cff could not be found. Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '3af68c35-9fc2-45b2-b943-4260fd8d6cff'} Sep 16 08:12:14.091993 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 3af68c35-9fc2-45b2-b943-4260fd8d6cff could not be found. (HTTP 404) (Request-ID: req-ccac0bb4-1fcf-43a8-8a3c-ffe71711f65b) Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:14.092998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 08:12:14.094431 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 3af68c35-9fc2-45b2-b943-4260fd8d6cff could not be found. Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 08:12:14.095913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 3af68c35-9fc2-45b2-b943-4260fd8d6cff could not be found. Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 3af68c35-9fc2-45b2-b943-4260fd8d6cff could not be found. Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9cb8b2dc-6bfc-4053-9b30-025af7d1e375 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Returning 404 to user: Volume 3af68c35-9fc2-45b2-b943-4260fd8d6cff could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9cb8b2dc-6bfc-4053-9b30-025af7d1e375 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/3af68c35-9fc2-45b2-b943-4260fd8d6cff" status: 404 len: 109 microversion: 2.1 time: 0.035198 Sep 16 08:12:14.097885 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 470/887] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Sep 16 08:12:14 2022] DELETE /compute/v2.1/os-volumes/3af68c35-9fc2-45b2-b943-4260fd8d6cff => generated 109 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 08:12:14.098967 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-29376f58-1026-44cf-a893-afc1c3b2c811 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Calling method '.version_select at 0x7f9d0699da60>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-29376f58-1026-44cf-a893-afc1c3b2c811 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] HTTP exception thrown: Volume 9c6de411-0915-44df-9042-a7a899ab5de8 could not be found. Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-29376f58-1026-44cf-a893-afc1c3b2c811 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Request method failure captured: Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/os-volumes/9c6de411-0915-44df-9042-a7a899ab5de8 HTTP/1.1 Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC_dxYTS-u6jUTP7ioYk_8LNjKpusku33DHSC9qr0qbNAIk4TLCEfHwIPeKY3YoAUUcTgVgyd7uXib60RLU-0btI3DCiur2FrmcqDPan6rGYVmmTP-uzINJkE2Adx9uzqaakBV_nMMujWQx3KX8t_jh8x198wIih6FZudPTNQ6iIH6A Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: b4dd748a933e4c24a85624347d2586fd Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:12:14.130983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b4dd748a933e4c24a85624347d2586fd", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b4dd748a933e4c24a85624347d2586fd"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: b4dd748a933e4c24a85624347d2586fd Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-VolumesNegativeTest-487116008 Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-VolumesNegativeTest-487116008-project Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: c8ca0777c691427e8249dbb3a69e17a3 Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-VolumesNegativeTest-487116008-project Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Volume 9c6de411-0915-44df-9042-a7a899ab5de8 could not be found. Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '9c6de411-0915-44df-9042-a7a899ab5de8'} Sep 16 08:12:14.133449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume 9c6de411-0915-44df-9042-a7a899ab5de8 could not be found. (HTTP 404) (Request-ID: req-663941aa-aed8-4255-9398-87128a56806f) Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:14.134273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 08:12:14.135595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume 9c6de411-0915-44df-9042-a7a899ab5de8 could not be found. Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 08:12:14.136780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume 9c6de411-0915-44df-9042-a7a899ab5de8 could not be found. Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume 9c6de411-0915-44df-9042-a7a899ab5de8 could not be found. Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-29376f58-1026-44cf-a893-afc1c3b2c811 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] Returning 404 to user: Volume 9c6de411-0915-44df-9042-a7a899ab5de8 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:14.138147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-29376f58-1026-44cf-a893-afc1c3b2c811 tempest-VolumesNegativeTest-487116008 tempest-VolumesNegativeTest-487116008-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/9c6de411-0915-44df-9042-a7a899ab5de8" status: 404 len: 109 microversion: 2.1 time: 0.037657 Sep 16 08:12:14.140417 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 471/888] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:12:14 2022] GET /compute/v2.1/os-volumes/9c6de411-0915-44df-9042-a7a899ab5de8 => generated 109 bytes in 48 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 08:12:14.340224 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-cd4bab5f-6248-4f00-a529-da0e48885c00 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "POST /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871747 Sep 16 08:12:14.340853 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 418/889] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:12:13 2022] POST /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/os-volume_attachments => generated 194 bytes in 874 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:12:14.605870 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-44d63d5c-104c-4898-aea2-2ffb1b1038bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:14.606576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-44d63d5c-104c-4898-aea2-2ffb1b1038bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:14.612903 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-44d63d5c-104c-4898-aea2-2ffb1b1038bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:14.613393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-44d63d5c-104c-4898-aea2-2ffb1b1038bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:14.614015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-44d63d5c-104c-4898-aea2-2ffb1b1038bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:14.614739 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-44d63d5c-104c-4898-aea2-2ffb1b1038bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:14.615207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-44d63d5c-104c-4898-aea2-2ffb1b1038bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:14.615801 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-44d63d5c-104c-4898-aea2-2ffb1b1038bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:14.759330 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-44d63d5c-104c-4898-aea2-2ffb1b1038bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:14.767465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-44d63d5c-104c-4898-aea2-2ffb1b1038bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:14.769428 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-44d63d5c-104c-4898-aea2-2ffb1b1038bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:14.770579 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-44d63d5c-104c-4898-aea2-2ffb1b1038bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.169037 Sep 16 08:12:14.771158 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 472/890] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:14 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:15.804326 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5212df59-db33-4cc9-ac85-30b9894b66ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:15.804963 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5212df59-db33-4cc9-ac85-30b9894b66ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:15.811232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5212df59-db33-4cc9-ac85-30b9894b66ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:15.811716 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5212df59-db33-4cc9-ac85-30b9894b66ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:15.812172 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5212df59-db33-4cc9-ac85-30b9894b66ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:15.812974 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5212df59-db33-4cc9-ac85-30b9894b66ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:15.813315 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5212df59-db33-4cc9-ac85-30b9894b66ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:15.813747 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5212df59-db33-4cc9-ac85-30b9894b66ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:15.954020 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5212df59-db33-4cc9-ac85-30b9894b66ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:15.963165 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5212df59-db33-4cc9-ac85-30b9894b66ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:15.964655 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5212df59-db33-4cc9-ac85-30b9894b66ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:15.965864 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5212df59-db33-4cc9-ac85-30b9894b66ce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.167159 Sep 16 08:12:15.966423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 419/891] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:15 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:16.995594 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-23c657a1-5335-4ffb-822b-b211e927eff0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:16.996289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-23c657a1-5335-4ffb-822b-b211e927eff0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:17.002553 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-23c657a1-5335-4ffb-822b-b211e927eff0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:17.003070 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-23c657a1-5335-4ffb-822b-b211e927eff0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:17.003508 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-23c657a1-5335-4ffb-822b-b211e927eff0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:17.004727 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-23c657a1-5335-4ffb-822b-b211e927eff0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:17.005180 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-23c657a1-5335-4ffb-822b-b211e927eff0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:17.005604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-23c657a1-5335-4ffb-822b-b211e927eff0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:17.137584 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-23c657a1-5335-4ffb-822b-b211e927eff0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:17.146772 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-23c657a1-5335-4ffb-822b-b211e927eff0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:17.148217 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-23c657a1-5335-4ffb-822b-b211e927eff0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:17.149408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-23c657a1-5335-4ffb-822b-b211e927eff0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.157774 Sep 16 08:12:17.149957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 473/892] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:16 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:18.176194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f9eadf07-6e94-4b51-8c46-e1870147e9cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:18.176807 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f9eadf07-6e94-4b51-8c46-e1870147e9cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:18.183825 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f9eadf07-6e94-4b51-8c46-e1870147e9cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:18.184314 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f9eadf07-6e94-4b51-8c46-e1870147e9cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:18.184752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f9eadf07-6e94-4b51-8c46-e1870147e9cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:18.185452 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f9eadf07-6e94-4b51-8c46-e1870147e9cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:18.185912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f9eadf07-6e94-4b51-8c46-e1870147e9cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:18.186376 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f9eadf07-6e94-4b51-8c46-e1870147e9cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:18.386764 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f9eadf07-6e94-4b51-8c46-e1870147e9cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:18.395427 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f9eadf07-6e94-4b51-8c46-e1870147e9cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:18.396910 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f9eadf07-6e94-4b51-8c46-e1870147e9cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:18.398171 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f9eadf07-6e94-4b51-8c46-e1870147e9cd tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.225989 Sep 16 08:12:18.398757 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 420/893] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:18 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 227 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:19.423402 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c72bfd04-9bcd-4bd4-8091-a09362bef66e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:19.424006 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c72bfd04-9bcd-4bd4-8091-a09362bef66e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:19.430500 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c72bfd04-9bcd-4bd4-8091-a09362bef66e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:19.431020 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c72bfd04-9bcd-4bd4-8091-a09362bef66e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:19.431454 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c72bfd04-9bcd-4bd4-8091-a09362bef66e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:19.432220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c72bfd04-9bcd-4bd4-8091-a09362bef66e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:19.432582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c72bfd04-9bcd-4bd4-8091-a09362bef66e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:19.433008 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c72bfd04-9bcd-4bd4-8091-a09362bef66e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:19.437109 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=97,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:19.562063 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c72bfd04-9bcd-4bd4-8091-a09362bef66e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:19.570765 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c72bfd04-9bcd-4bd4-8091-a09362bef66e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:19.572205 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c72bfd04-9bcd-4bd4-8091-a09362bef66e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:19.573363 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c72bfd04-9bcd-4bd4-8091-a09362bef66e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.153827 Sep 16 08:12:19.573922 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 474/894] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:19 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:20.600561 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-84ddad08-8d53-483c-a030-7047158f2e37 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:20.601231 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-84ddad08-8d53-483c-a030-7047158f2e37 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:20.607758 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-84ddad08-8d53-483c-a030-7047158f2e37 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:20.608239 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-84ddad08-8d53-483c-a030-7047158f2e37 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:20.608681 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-84ddad08-8d53-483c-a030-7047158f2e37 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:20.609373 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-84ddad08-8d53-483c-a030-7047158f2e37 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:20.609848 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-84ddad08-8d53-483c-a030-7047158f2e37 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:20.610258 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-84ddad08-8d53-483c-a030-7047158f2e37 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:20.801130 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-84ddad08-8d53-483c-a030-7047158f2e37 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:20.810043 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-84ddad08-8d53-483c-a030-7047158f2e37 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:20.811807 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-84ddad08-8d53-483c-a030-7047158f2e37 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:20.813054 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-84ddad08-8d53-483c-a030-7047158f2e37 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.217008 Sep 16 08:12:20.816775 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 421/895] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:20 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 220 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:21.842896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5570c38b-aab2-44d0-912a-347fb9bfd77e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:21.842896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5570c38b-aab2-44d0-912a-347fb9bfd77e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:21.849378 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5570c38b-aab2-44d0-912a-347fb9bfd77e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:21.849905 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5570c38b-aab2-44d0-912a-347fb9bfd77e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:21.850327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5570c38b-aab2-44d0-912a-347fb9bfd77e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:21.851225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5570c38b-aab2-44d0-912a-347fb9bfd77e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:21.851690 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5570c38b-aab2-44d0-912a-347fb9bfd77e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:21.852124 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5570c38b-aab2-44d0-912a-347fb9bfd77e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:21.996294 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5570c38b-aab2-44d0-912a-347fb9bfd77e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:22.004594 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5570c38b-aab2-44d0-912a-347fb9bfd77e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:22.006672 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5570c38b-aab2-44d0-912a-347fb9bfd77e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:22.009528 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5570c38b-aab2-44d0-912a-347fb9bfd77e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1745 microversion: 2.20 time: 0.169927 Sep 16 08:12:22.009528 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 475/896] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:21 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1745 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:23.034182 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1987d3a4-13a1-4ee8-bc52-4c76185097fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:23.035181 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1987d3a4-13a1-4ee8-bc52-4c76185097fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:23.045832 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1987d3a4-13a1-4ee8-bc52-4c76185097fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:23.046507 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1987d3a4-13a1-4ee8-bc52-4c76185097fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:23.047645 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1987d3a4-13a1-4ee8-bc52-4c76185097fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:23.048874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1987d3a4-13a1-4ee8-bc52-4c76185097fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:23.049533 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1987d3a4-13a1-4ee8-bc52-4c76185097fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:23.050162 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1987d3a4-13a1-4ee8-bc52-4c76185097fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:23.074035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-38034a66-5e82-4fae-9824-ebe6488b4f19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:23.074615 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-38034a66-5e82-4fae-9824-ebe6488b4f19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:23.082859 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-38034a66-5e82-4fae-9824-ebe6488b4f19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:23.083359 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-38034a66-5e82-4fae-9824-ebe6488b4f19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:23.084464 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-38034a66-5e82-4fae-9824-ebe6488b4f19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:23.085347 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-38034a66-5e82-4fae-9824-ebe6488b4f19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:23.085820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-38034a66-5e82-4fae-9824-ebe6488b4f19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:23.086252 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-38034a66-5e82-4fae-9824-ebe6488b4f19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:23.174479 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-38034a66-5e82-4fae-9824-ebe6488b4f19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lazy-loading 'services' on Instance uuid 6f515fbb-b67a-402f-8768-d42e46423db1 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:12:23.213244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1987d3a4-13a1-4ee8-bc52-4c76185097fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:23.222028 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1987d3a4-13a1-4ee8-bc52-4c76185097fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:23.226172 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-1987d3a4-13a1-4ee8-bc52-4c76185097fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:23.226172 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1987d3a4-13a1-4ee8-bc52-4c76185097fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1745 microversion: 2.20 time: 0.195516 Sep 16 08:12:23.226172 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 422/897] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:23 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1745 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:23.399011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-38034a66-5e82-4fae-9824-ebe6488b4f19 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/os-volume_attachments/5f22a683-05a9-4f26-93da-0245a7e8d394" status: 202 len: 0 microversion: 2.1 time: 0.328650 Sep 16 08:12:23.399533 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 476/898] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Sep 16 08:12:23 2022] DELETE /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/os-volume_attachments/5f22a683-05a9-4f26-93da-0245a7e8d394 => generated 0 bytes in 330 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 08:12:23.408293 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-70ca761a-b6bb-40f1-9713-615f2aae8365 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:23.410585 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-70ca761a-b6bb-40f1-9713-615f2aae8365 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:23.421344 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-70ca761a-b6bb-40f1-9713-615f2aae8365 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:23.421344 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-70ca761a-b6bb-40f1-9713-615f2aae8365 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:23.421344 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-70ca761a-b6bb-40f1-9713-615f2aae8365 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:23.421344 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-70ca761a-b6bb-40f1-9713-615f2aae8365 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:23.421729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-70ca761a-b6bb-40f1-9713-615f2aae8365 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:23.421729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-70ca761a-b6bb-40f1-9713-615f2aae8365 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:23.449086 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=96,nova_cell1:INSERT=2,nova_cell1:UPDATE=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:23.454057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-70ca761a-b6bb-40f1-9713-615f2aae8365 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.050033 Sep 16 08:12:23.454627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 423/899] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:12:23 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/os-volume_attachments => generated 197 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:23.928791 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-4944d9fa-0e7b-4d82-af2d-56bd837a9cb7 req-3e152f91-9b7c-4ee2-8c02-8964f586a2d7 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6b33b5-7327-4c2f-ae74-6f718e860360", "name": "network-vif-plugged", "status": "completed", "tag": "24fc5230-45b4-476e-ae08-dc736c4339d1"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:23.939420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-4944d9fa-0e7b-4d82-af2d-56bd837a9cb7 req-3e152f91-9b7c-4ee2-8c02-8964f586a2d7 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:23.939903 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-4944d9fa-0e7b-4d82-af2d-56bd837a9cb7 req-3e152f91-9b7c-4ee2-8c02-8964f586a2d7 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:23.940333 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-4944d9fa-0e7b-4d82-af2d-56bd837a9cb7 req-3e152f91-9b7c-4ee2-8c02-8964f586a2d7 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:23.967775 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-4944d9fa-0e7b-4d82-af2d-56bd837a9cb7 req-3e152f91-9b7c-4ee2-8c02-8964f586a2d7 service nova] Creating event network-vif-plugged:24fc5230-45b4-476e-ae08-dc736c4339d1 for instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 on hv-cinder-74014 Sep 16 08:12:23.972826 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-4944d9fa-0e7b-4d82-af2d-56bd837a9cb7 req-3e152f91-9b7c-4ee2-8c02-8964f586a2d7 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.048844 Sep 16 08:12:23.983204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 477/900] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:12:23 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:24.250237 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-49c3b053-1a5f-468f-8ea5-a3b3833d7f67 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:24.250933 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-49c3b053-1a5f-468f-8ea5-a3b3833d7f67 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:24.261345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-49c3b053-1a5f-468f-8ea5-a3b3833d7f67 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:24.262137 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-49c3b053-1a5f-468f-8ea5-a3b3833d7f67 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:24.262916 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-49c3b053-1a5f-468f-8ea5-a3b3833d7f67 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:24.263911 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-49c3b053-1a5f-468f-8ea5-a3b3833d7f67 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:24.265523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-49c3b053-1a5f-468f-8ea5-a3b3833d7f67 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:24.266214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-49c3b053-1a5f-468f-8ea5-a3b3833d7f67 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:24.410565 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-49c3b053-1a5f-468f-8ea5-a3b3833d7f67 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:24.420404 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-49c3b053-1a5f-468f-8ea5-a3b3833d7f67 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:24.421931 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-49c3b053-1a5f-468f-8ea5-a3b3833d7f67 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:24.423177 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-49c3b053-1a5f-468f-8ea5-a3b3833d7f67 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1745 microversion: 2.20 time: 0.177565 Sep 16 08:12:24.423937 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 424/901] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:24 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1745 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:24.468405 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-63c62d92-f046-43cd-b7f1-5c604b8d61ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:24.470762 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-63c62d92-f046-43cd-b7f1-5c604b8d61ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:24.477935 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-63c62d92-f046-43cd-b7f1-5c604b8d61ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:24.478421 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-63c62d92-f046-43cd-b7f1-5c604b8d61ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:24.478895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-63c62d92-f046-43cd-b7f1-5c604b8d61ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:24.479596 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-63c62d92-f046-43cd-b7f1-5c604b8d61ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:24.480052 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-63c62d92-f046-43cd-b7f1-5c604b8d61ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:24.480484 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-63c62d92-f046-43cd-b7f1-5c604b8d61ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:24.511625 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-63c62d92-f046-43cd-b7f1-5c604b8d61ce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/os-volume_attachments" status: 200 len: 197 microversion: 2.1 time: 0.048404 Sep 16 08:12:24.512184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 478/902] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:12:24 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/os-volume_attachments => generated 197 bytes in 50 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:25.449437 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e228b5ac-6ee0-4684-b629-186b531361d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:25.450188 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e228b5ac-6ee0-4684-b629-186b531361d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:25.457003 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e228b5ac-6ee0-4684-b629-186b531361d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:25.459768 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e228b5ac-6ee0-4684-b629-186b531361d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:25.459768 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e228b5ac-6ee0-4684-b629-186b531361d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:25.459768 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e228b5ac-6ee0-4684-b629-186b531361d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:25.459768 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e228b5ac-6ee0-4684-b629-186b531361d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:25.460355 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e228b5ac-6ee0-4684-b629-186b531361d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:25.525035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-660cf7f2-a248-4895-8438-e6912ab91891 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:25.527368 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-660cf7f2-a248-4895-8438-e6912ab91891 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:25.529585 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=40 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:25.534560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-660cf7f2-a248-4895-8438-e6912ab91891 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:25.535294 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-660cf7f2-a248-4895-8438-e6912ab91891 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:25.535743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-660cf7f2-a248-4895-8438-e6912ab91891 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:25.537550 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-660cf7f2-a248-4895-8438-e6912ab91891 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:25.538017 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-660cf7f2-a248-4895-8438-e6912ab91891 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:25.538627 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-660cf7f2-a248-4895-8438-e6912ab91891 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:25.571068 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-660cf7f2-a248-4895-8438-e6912ab91891 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/os-volume_attachments" status: 200 len: 25 microversion: 2.1 time: 0.050706 Sep 16 08:12:25.577761 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 479/903] 10.222.0.59 () {58 vars in 1302 bytes} [Fri Sep 16 08:12:25 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1/os-volume_attachments => generated 25 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 356 bytes (1 switches on core 0) Sep 16 08:12:25.609775 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e228b5ac-6ee0-4684-b629-186b531361d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:25.620644 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e228b5ac-6ee0-4684-b629-186b531361d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:25.620644 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e228b5ac-6ee0-4684-b629-186b531361d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:25.621711 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e228b5ac-6ee0-4684-b629-186b531361d4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1740 microversion: 2.20 time: 0.176367 Sep 16 08:12:25.622470 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 425/904] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:25 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1740 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:25.647875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0f246af9-04cc-4965-a3be-27a54be1698f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:25.648358 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0f246af9-04cc-4965-a3be-27a54be1698f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:25.654616 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0f246af9-04cc-4965-a3be-27a54be1698f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:25.655161 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0f246af9-04cc-4965-a3be-27a54be1698f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:25.655610 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0f246af9-04cc-4965-a3be-27a54be1698f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:25.656319 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0f246af9-04cc-4965-a3be-27a54be1698f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:25.656957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0f246af9-04cc-4965-a3be-27a54be1698f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:25.657394 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0f246af9-04cc-4965-a3be-27a54be1698f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:25.683881 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0f246af9-04cc-4965-a3be-27a54be1698f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:12:26.011284 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0f246af9-04cc-4965-a3be-27a54be1698f tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 204 len: 0 microversion: 2.1 time: 0.367528 Sep 16 08:12:26.011913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 480/905] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:12:25 2022] DELETE /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:12:26.020492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a894e105-0e39-496f-add8-dc859669ae15 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:26.021731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a894e105-0e39-496f-add8-dc859669ae15 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:26.029682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a894e105-0e39-496f-add8-dc859669ae15 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:26.030320 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a894e105-0e39-496f-add8-dc859669ae15 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:26.031140 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a894e105-0e39-496f-add8-dc859669ae15 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:26.031925 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a894e105-0e39-496f-add8-dc859669ae15 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:26.032619 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a894e105-0e39-496f-add8-dc859669ae15 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:26.033194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a894e105-0e39-496f-add8-dc859669ae15 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:26.183452 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a894e105-0e39-496f-add8-dc859669ae15 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:26.192624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a894e105-0e39-496f-add8-dc859669ae15 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1679 microversion: 2.1 time: 0.176098 Sep 16 08:12:26.194223 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 426/906] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:26 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1679 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:26.635408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1335627368", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "networks": [{"uuid": "a4c3bd05-db62-48c3-84ab-0949df8a6728"}]}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:26.649095 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d177e44e-3a12-465c-bcaa-776771ad88bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:26.649824 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d177e44e-3a12-465c-bcaa-776771ad88bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:26.657463 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d177e44e-3a12-465c-bcaa-776771ad88bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:26.668237 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d177e44e-3a12-465c-bcaa-776771ad88bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:26.668946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d177e44e-3a12-465c-bcaa-776771ad88bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:26.673180 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d177e44e-3a12-465c-bcaa-776771ad88bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:26.674491 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d177e44e-3a12-465c-bcaa-776771ad88bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:26.675096 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d177e44e-3a12-465c-bcaa-776771ad88bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:26.702783 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.network.neutron [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] validate_networks() for [('a4c3bd05-db62-48c3-84ab-0949df8a6728', None, None, None, None, None)] {{(pid=121046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:12:26.843471 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d177e44e-3a12-465c-bcaa-776771ad88bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:26.852810 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d177e44e-3a12-465c-bcaa-776771ad88bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:26.855477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d177e44e-3a12-465c-bcaa-776771ad88bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:26.857058 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d177e44e-3a12-465c-bcaa-776771ad88bc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1740 microversion: 2.20 time: 0.212513 Sep 16 08:12:26.870701 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 427/907] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:26 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1740 bytes in 215 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:27.142538 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Flavor limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:12:27.143101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Image limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:12:27.143692 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Flavor pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:12:27.144212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Image pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:12:27.144697 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:12:27.154282 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:27.155008 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:27.155591 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:27.156613 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:27.157401 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:27.157898 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:27.178024 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Getting quotas for project 9d32f40c2bd64a61aadd27f82d11191a. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:12:27.182628 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Getting quotas for user e9cd1b533aa8456d95e1bdbeac678b9f and project 9d32f40c2bd64a61aadd27f82d11191a. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:12:27.196821 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Going to run 1 instances... {{(pid=121046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:12:27.199895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:12:27.217618 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2bebcb49-5ac3-4d6e-aa93-b099fdd7a6e1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:27.218232 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2bebcb49-5ac3-4d6e-aa93-b099fdd7a6e1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:27.235230 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2bebcb49-5ac3-4d6e-aa93-b099fdd7a6e1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:27.235729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2bebcb49-5ac3-4d6e-aa93-b099fdd7a6e1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:27.236795 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2bebcb49-5ac3-4d6e-aa93-b099fdd7a6e1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:27.236906 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2bebcb49-5ac3-4d6e-aa93-b099fdd7a6e1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:27.237326 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2bebcb49-5ac3-4d6e-aa93-b099fdd7a6e1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:27.237757 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2bebcb49-5ac3-4d6e-aa93-b099fdd7a6e1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:27.410671 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2bebcb49-5ac3-4d6e-aa93-b099fdd7a6e1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:27.420654 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2bebcb49-5ac3-4d6e-aa93-b099fdd7a6e1 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1679 microversion: 2.1 time: 0.207040 Sep 16 08:12:27.421700 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 428/908] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:27 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1679 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:12:27.428600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cb83fec8-958d-4c05-a222-721dcdc15109 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.821229 Sep 16 08:12:27.429756 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 481/909] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:12:26 2022] POST /compute/v2.1/servers => generated 380 bytes in 823 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:12:27.442261 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3e7f4583-7149-4c3c-a994-87fb38a65ffc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:27.446297 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3e7f4583-7149-4c3c-a994-87fb38a65ffc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:27.521573 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3e7f4583-7149-4c3c-a994-87fb38a65ffc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:27.526044 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3e7f4583-7149-4c3c-a994-87fb38a65ffc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1214 microversion: 2.1 time: 0.089512 Sep 16 08:12:27.527207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 429/910] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:27 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1214 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:27.884089 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c6cc5685-612a-4107-9b53-2bc98f317051 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:27.885386 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c6cc5685-612a-4107-9b53-2bc98f317051 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:27.906148 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c6cc5685-612a-4107-9b53-2bc98f317051 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:27.907018 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c6cc5685-612a-4107-9b53-2bc98f317051 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.006s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:27.907626 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c6cc5685-612a-4107-9b53-2bc98f317051 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:27.908538 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c6cc5685-612a-4107-9b53-2bc98f317051 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:27.909157 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c6cc5685-612a-4107-9b53-2bc98f317051 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:27.909837 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c6cc5685-612a-4107-9b53-2bc98f317051 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:28.143983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c6cc5685-612a-4107-9b53-2bc98f317051 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:28.153009 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c6cc5685-612a-4107-9b53-2bc98f317051 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:28.156093 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c6cc5685-612a-4107-9b53-2bc98f317051 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:28.158116 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c6cc5685-612a-4107-9b53-2bc98f317051 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1740 microversion: 2.20 time: 0.278431 Sep 16 08:12:28.162707 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 482/911] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:27 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1740 bytes in 280 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:28.444950 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-27cf2672-7c9b-49e2-bcc3-6aa42c8b266b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:28.445566 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-27cf2672-7c9b-49e2-bcc3-6aa42c8b266b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:28.448884 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=51,nova_api:DELETE=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:28.455742 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-27cf2672-7c9b-49e2-bcc3-6aa42c8b266b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:28.456239 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-27cf2672-7c9b-49e2-bcc3-6aa42c8b266b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:28.456675 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-27cf2672-7c9b-49e2-bcc3-6aa42c8b266b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:28.457386 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-27cf2672-7c9b-49e2-bcc3-6aa42c8b266b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:28.457843 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-27cf2672-7c9b-49e2-bcc3-6aa42c8b266b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:28.459074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-27cf2672-7c9b-49e2-bcc3-6aa42c8b266b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:28.553679 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7b296b3a-e606-4c58-861f-92f62d9526db tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:28.555422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7b296b3a-e606-4c58-861f-92f62d9526db tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:28.564200 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b296b3a-e606-4c58-861f-92f62d9526db tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:28.565122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b296b3a-e606-4c58-861f-92f62d9526db tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:28.568131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b296b3a-e606-4c58-861f-92f62d9526db tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:28.569190 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b296b3a-e606-4c58-861f-92f62d9526db tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:28.570121 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b296b3a-e606-4c58-861f-92f62d9526db tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:28.574821 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7b296b3a-e606-4c58-861f-92f62d9526db tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:28.629949 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-27cf2672-7c9b-49e2-bcc3-6aa42c8b266b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:28.640795 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-27cf2672-7c9b-49e2-bcc3-6aa42c8b266b tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1679 microversion: 2.1 time: 0.198336 Sep 16 08:12:28.644778 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7b296b3a-e606-4c58-861f-92f62d9526db tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:28.652845 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 430/912] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:28 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1679 bytes in 213 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:28.663675 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7b296b3a-e606-4c58-861f-92f62d9526db tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1218 microversion: 2.1 time: 0.115975 Sep 16 08:12:28.666772 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 483/913] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:28 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1218 bytes in 118 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:12:29.184845 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b3c35968-0add-440b-bbfb-e79b9abeb505 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:29.185454 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b3c35968-0add-440b-bbfb-e79b9abeb505 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:29.191644 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b3c35968-0add-440b-bbfb-e79b9abeb505 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:29.192126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b3c35968-0add-440b-bbfb-e79b9abeb505 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:29.192559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b3c35968-0add-440b-bbfb-e79b9abeb505 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:29.193247 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b3c35968-0add-440b-bbfb-e79b9abeb505 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:29.193701 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b3c35968-0add-440b-bbfb-e79b9abeb505 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:29.194124 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b3c35968-0add-440b-bbfb-e79b9abeb505 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:29.332793 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b3c35968-0add-440b-bbfb-e79b9abeb505 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:29.341329 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b3c35968-0add-440b-bbfb-e79b9abeb505 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:29.341329 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b3c35968-0add-440b-bbfb-e79b9abeb505 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:29.341329 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b3c35968-0add-440b-bbfb-e79b9abeb505 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1740 microversion: 2.20 time: 0.160231 Sep 16 08:12:29.341910 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 431/914] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:29 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1740 bytes in 162 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:29.662642 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-25472cfc-44ca-4cae-9b38-35bbc8ab4876 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:29.663562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-25472cfc-44ca-4cae-9b38-35bbc8ab4876 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:29.673912 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-25472cfc-44ca-4cae-9b38-35bbc8ab4876 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:29.674490 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-25472cfc-44ca-4cae-9b38-35bbc8ab4876 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:29.682148 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-25472cfc-44ca-4cae-9b38-35bbc8ab4876 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:29.682148 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-25472cfc-44ca-4cae-9b38-35bbc8ab4876 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:29.682314 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-25472cfc-44ca-4cae-9b38-35bbc8ab4876 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:29.682813 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-25472cfc-44ca-4cae-9b38-35bbc8ab4876 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:29.690492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-202b8a81-daf7-4c95-9677-0b2d9d73fff7 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:29.691736 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-202b8a81-daf7-4c95-9677-0b2d9d73fff7 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:29.709280 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-202b8a81-daf7-4c95-9677-0b2d9d73fff7 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:29.710378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-202b8a81-daf7-4c95-9677-0b2d9d73fff7 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:29.711354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-202b8a81-daf7-4c95-9677-0b2d9d73fff7 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:29.714659 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-202b8a81-daf7-4c95-9677-0b2d9d73fff7 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:29.715954 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-202b8a81-daf7-4c95-9677-0b2d9d73fff7 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:29.716601 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-202b8a81-daf7-4c95-9677-0b2d9d73fff7 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:29.805074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-202b8a81-daf7-4c95-9677-0b2d9d73fff7 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:29.816889 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-202b8a81-daf7-4c95-9677-0b2d9d73fff7 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1218 microversion: 2.1 time: 0.132239 Sep 16 08:12:29.818162 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 432/915] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:29 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1218 bytes in 134 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:12:29.952982 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-25472cfc-44ca-4cae-9b38-35bbc8ab4876 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:29.963976 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-25472cfc-44ca-4cae-9b38-35bbc8ab4876 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1679 microversion: 2.1 time: 0.305141 Sep 16 08:12:29.964652 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 484/916] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:29 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1679 bytes in 306 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:30.368226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6cb61c97-ce18-4d89-ad6a-d1bd7cc76325 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:30.369283 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6cb61c97-ce18-4d89-ad6a-d1bd7cc76325 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:30.376011 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6cb61c97-ce18-4d89-ad6a-d1bd7cc76325 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:30.376724 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6cb61c97-ce18-4d89-ad6a-d1bd7cc76325 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:30.377432 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6cb61c97-ce18-4d89-ad6a-d1bd7cc76325 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:30.378296 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6cb61c97-ce18-4d89-ad6a-d1bd7cc76325 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:30.378771 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6cb61c97-ce18-4d89-ad6a-d1bd7cc76325 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:30.379437 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6cb61c97-ce18-4d89-ad6a-d1bd7cc76325 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:30.544736 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6cb61c97-ce18-4d89-ad6a-d1bd7cc76325 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:30.556214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6cb61c97-ce18-4d89-ad6a-d1bd7cc76325 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:30.557683 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6cb61c97-ce18-4d89-ad6a-d1bd7cc76325 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:30.558880 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6cb61c97-ce18-4d89-ad6a-d1bd7cc76325 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1740 microversion: 2.20 time: 0.195290 Sep 16 08:12:30.559762 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 433/917] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:30 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1740 bytes in 197 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:30.842908 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2c277a8d-9b3b-4ea0-a1da-b8e15720bd5f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:30.843649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2c277a8d-9b3b-4ea0-a1da-b8e15720bd5f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:30.862785 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2c277a8d-9b3b-4ea0-a1da-b8e15720bd5f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:30.864450 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2c277a8d-9b3b-4ea0-a1da-b8e15720bd5f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:30.868741 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2c277a8d-9b3b-4ea0-a1da-b8e15720bd5f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:30.873324 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2c277a8d-9b3b-4ea0-a1da-b8e15720bd5f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:30.874026 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2c277a8d-9b3b-4ea0-a1da-b8e15720bd5f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:30.876673 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2c277a8d-9b3b-4ea0-a1da-b8e15720bd5f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:30.921548 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-cda51dd5-3043-408b-a7ba-c606a3118365 req-abd16912-0bd7-48ef-a536-d0c71093aed6 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "6f515fbb-b67a-402f-8768-d42e46423db1", "name": "network-vif-deleted", "tag": "0952c557-1b1e-4f0b-84db-689b34cad324"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:30.943494 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-cda51dd5-3043-408b-a7ba-c606a3118365 req-abd16912-0bd7-48ef-a536-d0c71093aed6 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:30.944465 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-cda51dd5-3043-408b-a7ba-c606a3118365 req-abd16912-0bd7-48ef-a536-d0c71093aed6 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:30.946345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-cda51dd5-3043-408b-a7ba-c606a3118365 req-abd16912-0bd7-48ef-a536-d0c71093aed6 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:30.992186 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-cda51dd5-3043-408b-a7ba-c606a3118365 req-abd16912-0bd7-48ef-a536-d0c71093aed6 service nova] Creating event network-vif-deleted:0952c557-1b1e-4f0b-84db-689b34cad324 for instance 6f515fbb-b67a-402f-8768-d42e46423db1 on hv-cinder-74014 Sep 16 08:12:31.005151 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-cda51dd5-3043-408b-a7ba-c606a3118365 req-abd16912-0bd7-48ef-a536-d0c71093aed6 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.088272 Sep 16 08:12:31.007877 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 434/918] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:12:30 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 92 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:12:31.022156 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6c5cf21b-d7cf-42fc-9134-d6e6cbb97a80 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:31.024606 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6c5cf21b-d7cf-42fc-9134-d6e6cbb97a80 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:31.040780 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6c5cf21b-d7cf-42fc-9134-d6e6cbb97a80 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:31.044727 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6c5cf21b-d7cf-42fc-9134-d6e6cbb97a80 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.004s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:31.045331 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6c5cf21b-d7cf-42fc-9134-d6e6cbb97a80 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:31.046188 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6c5cf21b-d7cf-42fc-9134-d6e6cbb97a80 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:31.048067 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6c5cf21b-d7cf-42fc-9134-d6e6cbb97a80 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:31.049314 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6c5cf21b-d7cf-42fc-9134-d6e6cbb97a80 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:31.061002 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2c277a8d-9b3b-4ea0-a1da-b8e15720bd5f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:31.075979 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2c277a8d-9b3b-4ea0-a1da-b8e15720bd5f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1218 microversion: 2.1 time: 0.232568 Sep 16 08:12:31.077819 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 485/919] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:30 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1218 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:31.210747 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6c5cf21b-d7cf-42fc-9134-d6e6cbb97a80 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:31.226735 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6c5cf21b-d7cf-42fc-9134-d6e6cbb97a80 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1325 microversion: 2.1 time: 0.214405 Sep 16 08:12:31.227464 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 435/920] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:31 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1325 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:31.585641 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-eb178846-a158-47f5-be71-30e64be9490d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:31.586625 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-eb178846-a158-47f5-be71-30e64be9490d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:31.598209 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb178846-a158-47f5-be71-30e64be9490d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:31.599085 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb178846-a158-47f5-be71-30e64be9490d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:31.599812 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb178846-a158-47f5-be71-30e64be9490d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:31.600747 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb178846-a158-47f5-be71-30e64be9490d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:31.601442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb178846-a158-47f5-be71-30e64be9490d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:31.602092 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb178846-a158-47f5-be71-30e64be9490d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:31.829580 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-eb178846-a158-47f5-be71-30e64be9490d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:31.840447 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-eb178846-a158-47f5-be71-30e64be9490d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:31.841941 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-eb178846-a158-47f5-be71-30e64be9490d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:31.843268 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-eb178846-a158-47f5-be71-30e64be9490d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1740 microversion: 2.20 time: 0.262370 Sep 16 08:12:31.844197 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 486/921] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:31 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1740 bytes in 264 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:32.100587 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6abfd38b-2655-4823-8660-0245c1c1f913 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:32.101109 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6abfd38b-2655-4823-8660-0245c1c1f913 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:32.112976 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6abfd38b-2655-4823-8660-0245c1c1f913 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:32.113649 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6abfd38b-2655-4823-8660-0245c1c1f913 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:32.114331 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6abfd38b-2655-4823-8660-0245c1c1f913 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:32.116775 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6abfd38b-2655-4823-8660-0245c1c1f913 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:32.117660 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6abfd38b-2655-4823-8660-0245c1c1f913 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:32.118312 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6abfd38b-2655-4823-8660-0245c1c1f913 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:32.226279 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6abfd38b-2655-4823-8660-0245c1c1f913 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:32.239294 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6abfd38b-2655-4823-8660-0245c1c1f913 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1274 microversion: 2.1 time: 0.142563 Sep 16 08:12:32.249337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:32.250508 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:32.253800 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 436/922] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:32 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1274 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:32.257749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:32.258308 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:32.258842 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:32.259621 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:32.264244 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:32.264945 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:32.337737 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:32.338516 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:32.339978 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:32.340764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lazy-loading 'fault' on Instance uuid 6f515fbb-b67a-402f-8768-d42e46423db1 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:12:32.394581 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'ea2f6b804e164dbcb4f67926f23fdd59', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'b807736ef6c54be2b4715f32a4cfea57', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:32.410328 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5bbc9e27-12e5-48f6-b983-1d36d1b951bd tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 200 len: 1330 microversion: 2.1 time: 0.164618 Sep 16 08:12:32.411710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 487/923] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:32 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 1330 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:32.869736 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-87d1c7f2-d481-4600-9a87-4d8e7f9ff302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:32.870521 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-87d1c7f2-d481-4600-9a87-4d8e7f9ff302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:32.876917 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-87d1c7f2-d481-4600-9a87-4d8e7f9ff302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:32.877526 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-87d1c7f2-d481-4600-9a87-4d8e7f9ff302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:32.878066 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-87d1c7f2-d481-4600-9a87-4d8e7f9ff302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:32.878940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-87d1c7f2-d481-4600-9a87-4d8e7f9ff302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:32.879586 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-87d1c7f2-d481-4600-9a87-4d8e7f9ff302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:32.880419 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-87d1c7f2-d481-4600-9a87-4d8e7f9ff302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:33.121774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-87d1c7f2-d481-4600-9a87-4d8e7f9ff302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:33.130122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-87d1c7f2-d481-4600-9a87-4d8e7f9ff302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:33.132172 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-87d1c7f2-d481-4600-9a87-4d8e7f9ff302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:33.133718 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-87d1c7f2-d481-4600-9a87-4d8e7f9ff302 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1740 microversion: 2.20 time: 0.268093 Sep 16 08:12:33.134279 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 437/924] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:32 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1740 bytes in 269 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:33.281712 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2ea1ef3e-6368-4fbb-ae75-0f4b57da7d64 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:33.285545 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2ea1ef3e-6368-4fbb-ae75-0f4b57da7d64 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:33.289056 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2ea1ef3e-6368-4fbb-ae75-0f4b57da7d64 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:33.289418 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2ea1ef3e-6368-4fbb-ae75-0f4b57da7d64 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:33.289859 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2ea1ef3e-6368-4fbb-ae75-0f4b57da7d64 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:33.290563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2ea1ef3e-6368-4fbb-ae75-0f4b57da7d64 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:33.291051 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2ea1ef3e-6368-4fbb-ae75-0f4b57da7d64 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:33.291485 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2ea1ef3e-6368-4fbb-ae75-0f4b57da7d64 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:33.355751 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2ea1ef3e-6368-4fbb-ae75-0f4b57da7d64 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:33.364427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2ea1ef3e-6368-4fbb-ae75-0f4b57da7d64 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1272 microversion: 2.1 time: 0.086966 Sep 16 08:12:33.365967 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 488/925] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:33 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1272 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:33.438776 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e6d42cb8-418f-4a66-a444-a5e6e7fa1b24 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:33.440671 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e6d42cb8-418f-4a66-a444-a5e6e7fa1b24 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:33.448333 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e6d42cb8-418f-4a66-a444-a5e6e7fa1b24 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:33.448849 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e6d42cb8-418f-4a66-a444-a5e6e7fa1b24 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:33.457121 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e6d42cb8-418f-4a66-a444-a5e6e7fa1b24 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.008s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:33.457878 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e6d42cb8-418f-4a66-a444-a5e6e7fa1b24 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:33.458349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e6d42cb8-418f-4a66-a444-a5e6e7fa1b24 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:33.463571 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e6d42cb8-418f-4a66-a444-a5e6e7fa1b24 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:33.477459 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-e6d42cb8-418f-4a66-a444-a5e6e7fa1b24 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e6d42cb8-418f-4a66-a444-a5e6e7fa1b24 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 HTTP/1.1 Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:12:33.479226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:12:33.480940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:33.480940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:33.480940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:33.480940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:33.480940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:33.480940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:12:33.480940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:12:33.480940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:12:33.480940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:33.480940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:12:33.480940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:33.480940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '6f515fbb-b67a-402f-8768-d42e46423db1'} Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:33.482200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:33.487893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:33.489163 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e6d42cb8-418f-4a66-a444-a5e6e7fa1b24 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 404 to user: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:33.489163 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e6d42cb8-418f-4a66-a444-a5e6e7fa1b24 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 404 len: 111 microversion: 2.1 time: 0.045814 Sep 16 08:12:33.489163 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 438/926] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:33 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 111 bytes in 47 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:12:33.495376 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9ec0a103-2c2c-4f63-83eb-7697064595f7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '.version_select at 0x7f9d069b2a60>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:33.581960 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9ec0a103-2c2c-4f63-83eb-7697064595f7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-420039010" status: 202 len: 0 microversion: 2.1 time: 0.090766 Sep 16 08:12:33.583187 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 489/927] 10.222.0.59 () {58 vars in 1218 bytes} [Fri Sep 16 08:12:33 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-420039010 => generated 0 bytes in 93 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:12:34.160059 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b006284f-cf75-4f50-92b4-72610b1cb30c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:34.161245 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b006284f-cf75-4f50-92b4-72610b1cb30c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:34.172384 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b006284f-cf75-4f50-92b4-72610b1cb30c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:34.181095 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b006284f-cf75-4f50-92b4-72610b1cb30c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.009s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:34.181735 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b006284f-cf75-4f50-92b4-72610b1cb30c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:34.182672 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b006284f-cf75-4f50-92b4-72610b1cb30c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:34.183891 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b006284f-cf75-4f50-92b4-72610b1cb30c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:34.185456 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b006284f-cf75-4f50-92b4-72610b1cb30c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:34.392605 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-af166693-3f59-4cf4-b4e9-998d5d57618a tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:34.396029 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-af166693-3f59-4cf4-b4e9-998d5d57618a tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:34.403302 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-af166693-3f59-4cf4-b4e9-998d5d57618a tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:34.404406 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-af166693-3f59-4cf4-b4e9-998d5d57618a tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:34.405091 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-af166693-3f59-4cf4-b4e9-998d5d57618a tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:34.406239 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-af166693-3f59-4cf4-b4e9-998d5d57618a tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:34.407015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-af166693-3f59-4cf4-b4e9-998d5d57618a tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:34.407679 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-af166693-3f59-4cf4-b4e9-998d5d57618a tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:34.441269 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=97,nova_cell1:INSERT=2,nova_cell1:UPDATE=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:34.532833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b006284f-cf75-4f50-92b4-72610b1cb30c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:34.550560 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b006284f-cf75-4f50-92b4-72610b1cb30c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:34.555602 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b006284f-cf75-4f50-92b4-72610b1cb30c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:34.557730 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b006284f-cf75-4f50-92b4-72610b1cb30c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1740 microversion: 2.20 time: 0.401725 Sep 16 08:12:34.572891 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 439/928] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:34 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1740 bytes in 417 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:34.664691 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-af166693-3f59-4cf4-b4e9-998d5d57618a tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:34.678743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-af166693-3f59-4cf4-b4e9-998d5d57618a tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1314 microversion: 2.1 time: 0.291962 Sep 16 08:12:34.679669 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 490/929] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:34 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1314 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:34.831452 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-664915f5-6217-486b-8ea0-b7a288bce6c8 req-7190b554-8b42-4055-8889-ff6f05dd0323 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a", "tag": "e24b0b86-8679-4330-a999-3826f76e950a"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:34.843546 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-664915f5-6217-486b-8ea0-b7a288bce6c8 req-7190b554-8b42-4055-8889-ff6f05dd0323 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:34.844319 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-664915f5-6217-486b-8ea0-b7a288bce6c8 req-7190b554-8b42-4055-8889-ff6f05dd0323 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:34.844917 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-664915f5-6217-486b-8ea0-b7a288bce6c8 req-7190b554-8b42-4055-8889-ff6f05dd0323 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:34.870167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-664915f5-6217-486b-8ea0-b7a288bce6c8 req-7190b554-8b42-4055-8889-ff6f05dd0323 service nova] Creating event network-changed:e24b0b86-8679-4330-a999-3826f76e950a for instance dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a on hv-cinder-74014 Sep 16 08:12:34.877233 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-664915f5-6217-486b-8ea0-b7a288bce6c8 req-7190b554-8b42-4055-8889-ff6f05dd0323 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049191 Sep 16 08:12:34.878384 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 440/930] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:12:34 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:35.586098 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-bbe998a0-f46e-488f-98be-83cd45037bd4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:35.586771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-bbe998a0-f46e-488f-98be-83cd45037bd4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:35.593923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bbe998a0-f46e-488f-98be-83cd45037bd4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:35.594630 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bbe998a0-f46e-488f-98be-83cd45037bd4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:35.597430 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bbe998a0-f46e-488f-98be-83cd45037bd4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:35.597430 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bbe998a0-f46e-488f-98be-83cd45037bd4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:35.597430 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bbe998a0-f46e-488f-98be-83cd45037bd4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:35.597430 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-bbe998a0-f46e-488f-98be-83cd45037bd4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:35.705252 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e0e269e9-f4ec-4c3a-8ae6-c46cfed59084 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:35.708159 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e0e269e9-f4ec-4c3a-8ae6-c46cfed59084 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:35.715765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e0e269e9-f4ec-4c3a-8ae6-c46cfed59084 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:35.717350 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e0e269e9-f4ec-4c3a-8ae6-c46cfed59084 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:35.717977 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e0e269e9-f4ec-4c3a-8ae6-c46cfed59084 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:35.727625 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e0e269e9-f4ec-4c3a-8ae6-c46cfed59084 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:35.728397 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e0e269e9-f4ec-4c3a-8ae6-c46cfed59084 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:35.729036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e0e269e9-f4ec-4c3a-8ae6-c46cfed59084 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:35.935295 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e0e269e9-f4ec-4c3a-8ae6-c46cfed59084 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:35.945102 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e0e269e9-f4ec-4c3a-8ae6-c46cfed59084 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1314 microversion: 2.1 time: 0.244589 Sep 16 08:12:35.946305 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 441/931] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:35 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1314 bytes in 247 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:12:35.966139 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-bbe998a0-f46e-488f-98be-83cd45037bd4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:35.979011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-bbe998a0-f46e-488f-98be-83cd45037bd4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:35.980871 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-bbe998a0-f46e-488f-98be-83cd45037bd4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:35.982293 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-bbe998a0-f46e-488f-98be-83cd45037bd4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1740 microversion: 2.20 time: 0.401251 Sep 16 08:12:36.008362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a5b63625-f3c7-4690-afae-1d58ab3ae432 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:36.009895 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a5b63625-f3c7-4690-afae-1d58ab3ae432 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:36.012689 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 491/932] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:35 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1740 bytes in 432 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:36.018302 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5b63625-f3c7-4690-afae-1d58ab3ae432 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:36.018828 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5b63625-f3c7-4690-afae-1d58ab3ae432 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:36.019447 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5b63625-f3c7-4690-afae-1d58ab3ae432 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:36.020178 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5b63625-f3c7-4690-afae-1d58ab3ae432 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:36.020722 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5b63625-f3c7-4690-afae-1d58ab3ae432 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:36.021164 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a5b63625-f3c7-4690-afae-1d58ab3ae432 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:36.038820 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-a5b63625-f3c7-4690-afae-1d58ab3ae432 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a5b63625-f3c7-4690-afae-1d58ab3ae432 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: DELETE /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 HTTP/1.1 Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:12:36.040948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:12:36.042572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:36.042572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:36.042572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:36.042572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:36.042572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:36.042572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:12:36.042572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:12:36.042572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:12:36.042572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:36.042572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:12:36.042572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:36.042572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '6f515fbb-b67a-402f-8768-d42e46423db1'} Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:36.043544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:36.045049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:36.047435 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a5b63625-f3c7-4690-afae-1d58ab3ae432 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 404 to user: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:36.048631 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a5b63625-f3c7-4690-afae-1d58ab3ae432 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 404 len: 111 microversion: 2.1 time: 0.053028 Sep 16 08:12:36.049625 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 442/933] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:12:35 2022] DELETE /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 111 bytes in 54 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:12:36.058411 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-04d6a333-878a-4039-b7c2-98a4f8d4c4f2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:36.060075 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-04d6a333-878a-4039-b7c2-98a4f8d4c4f2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6f515fbb-b67a-402f-8768-d42e46423db1] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:36.068291 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-04d6a333-878a-4039-b7c2-98a4f8d4c4f2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:36.069328 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-04d6a333-878a-4039-b7c2-98a4f8d4c4f2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:36.069799 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-04d6a333-878a-4039-b7c2-98a4f8d4c4f2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:36.070535 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-04d6a333-878a-4039-b7c2-98a4f8d4c4f2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:36.071246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-04d6a333-878a-4039-b7c2-98a4f8d4c4f2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:36.071679 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-04d6a333-878a-4039-b7c2-98a4f8d4c4f2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:36.091753 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-04d6a333-878a-4039-b7c2-98a4f8d4c4f2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-04d6a333-878a-4039-b7c2-98a4f8d4c4f2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 HTTP/1.1 Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:12:36.093990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:12:36.095415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:36.095415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:36.095415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:36.095415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:36.095415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:36.095415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:12:36.095415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:12:36.095415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:12:36.095415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:36.095415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:12:36.095415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:36.095415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '6f515fbb-b67a-402f-8768-d42e46423db1'} Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:36.096234 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. Sep 16 08:12:36.097568 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:36.098704 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-04d6a333-878a-4039-b7c2-98a4f8d4c4f2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 404 to user: Instance 6f515fbb-b67a-402f-8768-d42e46423db1 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:36.098704 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-04d6a333-878a-4039-b7c2-98a4f8d4c4f2 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1" status: 404 len: 111 microversion: 2.1 time: 0.042968 Sep 16 08:12:36.103452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 492/934] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:36 2022] GET /compute/v2.1/servers/6f515fbb-b67a-402f-8768-d42e46423db1 => generated 111 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:12:36.969474 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-79d842d6-10aa-4b46-829d-9388184f7883 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:36.970263 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-79d842d6-10aa-4b46-829d-9388184f7883 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:36.978398 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-79d842d6-10aa-4b46-829d-9388184f7883 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:36.978398 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-79d842d6-10aa-4b46-829d-9388184f7883 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:36.978898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-79d842d6-10aa-4b46-829d-9388184f7883 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:36.979213 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-79d842d6-10aa-4b46-829d-9388184f7883 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:36.979709 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-79d842d6-10aa-4b46-829d-9388184f7883 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:36.980193 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-79d842d6-10aa-4b46-829d-9388184f7883 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:37.013651 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d8c635c8-a064-4f08-9bde-71891a77e7a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:37.014438 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d8c635c8-a064-4f08-9bde-71891a77e7a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:37.021010 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d8c635c8-a064-4f08-9bde-71891a77e7a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:37.022131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d8c635c8-a064-4f08-9bde-71891a77e7a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:37.022610 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d8c635c8-a064-4f08-9bde-71891a77e7a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:37.023423 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d8c635c8-a064-4f08-9bde-71891a77e7a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:37.023943 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d8c635c8-a064-4f08-9bde-71891a77e7a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:37.024432 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d8c635c8-a064-4f08-9bde-71891a77e7a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:37.117963 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-79d842d6-10aa-4b46-829d-9388184f7883 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:37.127476 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-79d842d6-10aa-4b46-829d-9388184f7883 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1314 microversion: 2.1 time: 0.161800 Sep 16 08:12:37.128553 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 443/935] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:36 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1314 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:37.168213 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d8c635c8-a064-4f08-9bde-71891a77e7a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:37.170668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:37.178437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d8c635c8-a064-4f08-9bde-71891a77e7a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:37.181229 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d8c635c8-a064-4f08-9bde-71891a77e7a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:37.181936 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d8c635c8-a064-4f08-9bde-71891a77e7a4 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1740 microversion: 2.20 time: 0.172243 Sep 16 08:12:37.182657 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 493/936] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:37 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1740 bytes in 174 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:12:37.378201 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f70f75d8-a504-4de7-81a6-940b928550b7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:37.378720 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f70f75d8-a504-4de7-81a6-940b928550b7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:37.385466 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f70f75d8-a504-4de7-81a6-940b928550b7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:37.386008 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f70f75d8-a504-4de7-81a6-940b928550b7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:37.386449 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f70f75d8-a504-4de7-81a6-940b928550b7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:37.387181 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f70f75d8-a504-4de7-81a6-940b928550b7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:37.387641 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f70f75d8-a504-4de7-81a6-940b928550b7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:37.388073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f70f75d8-a504-4de7-81a6-940b928550b7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:37.390801 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=100 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:37.403727 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-f70f75d8-a504-4de7-81a6-940b928550b7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f70f75d8-a504-4de7-81a6-940b928550b7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: DELETE /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 HTTP/1.1 Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:12:37.405334 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:12:37.411752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:37.411752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:37.411752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:37.411752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:37.411752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:37.411752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:12:37.411752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:12:37.411752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:12:37.411752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:37.411752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:12:37.411752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:12:37.411752 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': 'ea13dc92-1066-46f6-9fda-8d87d3721731'} Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:37.412552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:12:37.413833 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.415176 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f70f75d8-a504-4de7-81a6-940b928550b7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 404 to user: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:37.415176 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f70f75d8-a504-4de7-81a6-940b928550b7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 404 len: 111 microversion: 2.1 time: 0.032604 Sep 16 08:12:37.415176 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 444/937] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:12:37 2022] DELETE /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:12:37.417330 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-44a2a378-3d64-4f06-9aaa-26cc7964d832 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:37.417942 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-44a2a378-3d64-4f06-9aaa-26cc7964d832 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: ea13dc92-1066-46f6-9fda-8d87d3721731] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:37.421128 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=6 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:37.425060 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-44a2a378-3d64-4f06-9aaa-26cc7964d832 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:37.425539 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-44a2a378-3d64-4f06-9aaa-26cc7964d832 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:37.426563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-44a2a378-3d64-4f06-9aaa-26cc7964d832 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:37.427271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-44a2a378-3d64-4f06-9aaa-26cc7964d832 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:37.427787 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-44a2a378-3d64-4f06-9aaa-26cc7964d832 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:37.433360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-44a2a378-3d64-4f06-9aaa-26cc7964d832 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:37.442111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-44a2a378-3d64-4f06-9aaa-26cc7964d832 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-44a2a378-3d64-4f06-9aaa-26cc7964d832 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 HTTP/1.1 Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:12:37.444465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:12:37.445872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:37.445872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:37.445872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:37.445872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:37.445872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:37.445872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:12:37.445872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:12:37.445872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:12:37.445872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:37.445872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:12:37.445872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:12:37.445872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': 'ea13dc92-1066-46f6-9fda-8d87d3721731'} Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:37.446658 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. Sep 16 08:12:37.447924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.449122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-44a2a378-3d64-4f06-9aaa-26cc7964d832 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 404 to user: Instance ea13dc92-1066-46f6-9fda-8d87d3721731 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:37.449122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-44a2a378-3d64-4f06-9aaa-26cc7964d832 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731" status: 404 len: 111 microversion: 2.1 time: 0.033997 Sep 16 08:12:37.449122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 494/938] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:37 2022] GET /compute/v2.1/servers/ea13dc92-1066-46f6-9fda-8d87d3721731 => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:12:37.456448 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0be48f2f-535c-4cab-9f99-18d929d5cce3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:37.456448 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0be48f2f-535c-4cab-9f99-18d929d5cce3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:37.464855 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0be48f2f-535c-4cab-9f99-18d929d5cce3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:37.465348 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0be48f2f-535c-4cab-9f99-18d929d5cce3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:37.465790 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0be48f2f-535c-4cab-9f99-18d929d5cce3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:37.466494 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0be48f2f-535c-4cab-9f99-18d929d5cce3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:37.467053 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0be48f2f-535c-4cab-9f99-18d929d5cce3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:37.467473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0be48f2f-535c-4cab-9f99-18d929d5cce3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:37.483889 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-0be48f2f-535c-4cab-9f99-18d929d5cce3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0be48f2f-535c-4cab-9f99-18d929d5cce3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: DELETE /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce HTTP/1.1 Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:12:37.485551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:12:37.487175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:37.487175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:37.487175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:37.487175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:37.487175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:37.487175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:12:37.487175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:12:37.487175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:12:37.487175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:37.487175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:12:37.487175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:12:37.487175 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '6372a5c9-25ed-4593-861f-78a0f8cf03ce'} Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:37.487946 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:12:37.489624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.492228 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0be48f2f-535c-4cab-9f99-18d929d5cce3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 404 to user: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:37.492228 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0be48f2f-535c-4cab-9f99-18d929d5cce3 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 404 len: 111 microversion: 2.1 time: 0.035134 Sep 16 08:12:37.492228 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 445/939] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:12:37 2022] DELETE /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 111 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:12:37.497153 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-71f60430-689c-4aee-ba3a-e4b22d0adcce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:37.498086 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-71f60430-689c-4aee-ba3a-e4b22d0adcce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 6372a5c9-25ed-4593-861f-78a0f8cf03ce] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:37.506257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-71f60430-689c-4aee-ba3a-e4b22d0adcce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:37.511700 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-71f60430-689c-4aee-ba3a-e4b22d0adcce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:37.511700 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-71f60430-689c-4aee-ba3a-e4b22d0adcce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:37.511700 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-71f60430-689c-4aee-ba3a-e4b22d0adcce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:37.511700 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-71f60430-689c-4aee-ba3a-e4b22d0adcce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:37.512051 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-71f60430-689c-4aee-ba3a-e4b22d0adcce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:37.532670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-71f60430-689c-4aee-ba3a-e4b22d0adcce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-71f60430-689c-4aee-ba3a-e4b22d0adcce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce HTTP/1.1 Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:12:37.534214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:12:37.535636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:37.535636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:37.535636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:37.535636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:37.535636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:37.535636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:12:37.535636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:12:37.535636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:12:37.535636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:37.535636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:12:37.535636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:12:37.535636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '6372a5c9-25ed-4593-861f-78a0f8cf03ce'} Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:37.536403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. Sep 16 08:12:37.538443 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:37.543203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-71f60430-689c-4aee-ba3a-e4b22d0adcce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 404 to user: Instance 6372a5c9-25ed-4593-861f-78a0f8cf03ce could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:37.543203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-71f60430-689c-4aee-ba3a-e4b22d0adcce tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce" status: 404 len: 111 microversion: 2.1 time: 0.042512 Sep 16 08:12:37.543203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 495/940] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:37 2022] GET /compute/v2.1/servers/6372a5c9-25ed-4593-861f-78a0f8cf03ce => generated 111 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:12:38.152646 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6d70033c-d9e4-4ef5-a454-c740976aff86 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:38.153258 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6d70033c-d9e4-4ef5-a454-c740976aff86 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:38.155479 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:38.160776 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6d70033c-d9e4-4ef5-a454-c740976aff86 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:38.161199 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6d70033c-d9e4-4ef5-a454-c740976aff86 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:38.161634 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6d70033c-d9e4-4ef5-a454-c740976aff86 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:38.162371 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6d70033c-d9e4-4ef5-a454-c740976aff86 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:38.162883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6d70033c-d9e4-4ef5-a454-c740976aff86 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:38.163306 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6d70033c-d9e4-4ef5-a454-c740976aff86 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:38.234273 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0b6f4c5c-02ef-4d96-a885-dd954af5f786 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:38.235131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0b6f4c5c-02ef-4d96-a885-dd954af5f786 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:38.242163 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0b6f4c5c-02ef-4d96-a885-dd954af5f786 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:38.242717 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0b6f4c5c-02ef-4d96-a885-dd954af5f786 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:38.243163 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0b6f4c5c-02ef-4d96-a885-dd954af5f786 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:38.244127 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0b6f4c5c-02ef-4d96-a885-dd954af5f786 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:38.244760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0b6f4c5c-02ef-4d96-a885-dd954af5f786 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:38.245362 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0b6f4c5c-02ef-4d96-a885-dd954af5f786 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:38.340928 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6d70033c-d9e4-4ef5-a454-c740976aff86 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:38.347212 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6d70033c-d9e4-4ef5-a454-c740976aff86 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1314 microversion: 2.1 time: 0.200531 Sep 16 08:12:38.347796 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 446/941] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:38 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1314 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:38.394475 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0b6f4c5c-02ef-4d96-a885-dd954af5f786 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:38.402806 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0b6f4c5c-02ef-4d96-a885-dd954af5f786 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:38.404504 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0b6f4c5c-02ef-4d96-a885-dd954af5f786 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:38.405696 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0b6f4c5c-02ef-4d96-a885-dd954af5f786 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1740 microversion: 2.20 time: 0.176023 Sep 16 08:12:38.406246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 496/942] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:38 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1740 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:12:38.859482 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d48ada89-1634-4f5b-ba6f-2919e7912ada tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:38.859993 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d48ada89-1634-4f5b-ba6f-2919e7912ada tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:38.866578 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d48ada89-1634-4f5b-ba6f-2919e7912ada tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:38.867106 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d48ada89-1634-4f5b-ba6f-2919e7912ada tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:38.867549 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d48ada89-1634-4f5b-ba6f-2919e7912ada tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:38.868256 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d48ada89-1634-4f5b-ba6f-2919e7912ada tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:38.868800 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d48ada89-1634-4f5b-ba6f-2919e7912ada tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:38.869239 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d48ada89-1634-4f5b-ba6f-2919e7912ada tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:38.883192 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-d48ada89-1634-4f5b-ba6f-2919e7912ada tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d48ada89-1634-4f5b-ba6f-2919e7912ada tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: DELETE /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 HTTP/1.1 Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:12:38.884772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:12:38.886394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:38.886394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:38.886394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:38.886394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:38.886394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:38.886394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:12:38.886394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:12:38.886394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:12:38.886394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:38.886394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:12:38.886394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:12:38.886394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '547e4d8b-02bd-4033-82b3-04db0ba60fe5'} Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:38.887287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:12:38.888808 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:12:38.890203 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d48ada89-1634-4f5b-ba6f-2919e7912ada tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 404 to user: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:38.890203 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d48ada89-1634-4f5b-ba6f-2919e7912ada tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "DELETE /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 404 len: 111 microversion: 2.1 time: 0.030740 Sep 16 08:12:38.890203 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 447/943] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:12:38 2022] DELETE /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 08:12:38.894795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-55bdbe44-b40a-4d1e-a0bc-2f275d25cdd7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:38.895426 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-55bdbe44-b40a-4d1e-a0bc-2f275d25cdd7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] [instance: 547e4d8b-02bd-4033-82b3-04db0ba60fe5] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:38.901515 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55bdbe44-b40a-4d1e-a0bc-2f275d25cdd7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:38.906151 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55bdbe44-b40a-4d1e-a0bc-2f275d25cdd7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:38.906151 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55bdbe44-b40a-4d1e-a0bc-2f275d25cdd7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:38.906151 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55bdbe44-b40a-4d1e-a0bc-2f275d25cdd7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:38.906151 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55bdbe44-b40a-4d1e-a0bc-2f275d25cdd7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:38.906542 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55bdbe44-b40a-4d1e-a0bc-2f275d25cdd7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:38.919041 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-55bdbe44-b40a-4d1e-a0bc-2f275d25cdd7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] HTTP exception thrown: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-55bdbe44-b40a-4d1e-a0bc-2f275d25cdd7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Request method failure captured: Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 HTTP/1.1 Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC5AeXV7JCQACwNQq1f8k5ljD3NqdeocXOmY5IWR_xTviTUlKWAa1BvSUcindn5FCeABVZz6HmFtpcb9t0ar8RtzhOg2HMQ6FnyJTpbk9NlEAKSFdYCbMB0qsNNDm6-1mZMXaW5W9MNBFXXdklp-XCuwggT7CHeQkx2VSc_KxKYzqGI Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:12:38.920603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:12:38.922137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_b807736ef6c54be2b4715f32a4cfea57", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/b807736ef6c54be2b4715f32a4cfea57"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:38.922137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:38.922137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: b807736ef6c54be2b4715f32a4cfea57 Sep 16 08:12:38.922137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-AttachVolumeNegativeTest-2055762860 Sep 16 08:12:38.922137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:38.922137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:12:38.922137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:12:38.922137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: ea2f6b804e164dbcb4f67926f23fdd59 Sep 16 08:12:38.922137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-AttachVolumeNegativeTest-2055762860-project Sep 16 08:12:38.922137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:12:38.922137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:12:38.922137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '547e4d8b-02bd-4033-82b3-04db0ba60fe5'} Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:38.923004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. Sep 16 08:12:38.924395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:38.925519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-55bdbe44-b40a-4d1e-a0bc-2f275d25cdd7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] Returning 404 to user: Instance 547e4d8b-02bd-4033-82b3-04db0ba60fe5 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:38.925519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-55bdbe44-b40a-4d1e-a0bc-2f275d25cdd7 tempest-AttachVolumeNegativeTest-2055762860 tempest-AttachVolumeNegativeTest-2055762860-project] 10.222.0.59 "GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5" status: 404 len: 111 microversion: 2.1 time: 0.031144 Sep 16 08:12:38.926149 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 497/944] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:38 2022] GET /compute/v2.1/servers/547e4d8b-02bd-4033-82b3-04db0ba60fe5 => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:12:39.371270 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-31a4f22d-a55f-4056-a558-ff53f4f78446 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:39.372542 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-31a4f22d-a55f-4056-a558-ff53f4f78446 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:39.386637 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-31a4f22d-a55f-4056-a558-ff53f4f78446 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:39.388360 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-31a4f22d-a55f-4056-a558-ff53f4f78446 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:39.391477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-31a4f22d-a55f-4056-a558-ff53f4f78446 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:39.391477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-31a4f22d-a55f-4056-a558-ff53f4f78446 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:39.393882 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-31a4f22d-a55f-4056-a558-ff53f4f78446 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:39.394755 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-31a4f22d-a55f-4056-a558-ff53f4f78446 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:39.433212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-76da67f3-a807-4086-ab31-635bf7c0611d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:39.434506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-76da67f3-a807-4086-ab31-635bf7c0611d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:39.448147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-76da67f3-a807-4086-ab31-635bf7c0611d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:39.451195 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-76da67f3-a807-4086-ab31-635bf7c0611d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:39.451897 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-76da67f3-a807-4086-ab31-635bf7c0611d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:39.452811 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-76da67f3-a807-4086-ab31-635bf7c0611d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:39.455185 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-76da67f3-a807-4086-ab31-635bf7c0611d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:39.457127 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-76da67f3-a807-4086-ab31-635bf7c0611d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:39.709855 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-76da67f3-a807-4086-ab31-635bf7c0611d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:39.725944 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-76da67f3-a807-4086-ab31-635bf7c0611d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:39.725944 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-76da67f3-a807-4086-ab31-635bf7c0611d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:39.725944 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-76da67f3-a807-4086-ab31-635bf7c0611d tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1722 microversion: 2.20 time: 0.296287 Sep 16 08:12:39.730163 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 498/945] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:39 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1722 bytes in 303 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:12:39.938148 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-31a4f22d-a55f-4056-a558-ff53f4f78446 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:39.948072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-31a4f22d-a55f-4056-a558-ff53f4f78446 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1314 microversion: 2.1 time: 0.582515 Sep 16 08:12:39.964504 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 448/946] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:39 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1314 bytes in 600 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:40.754939 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-93d5b259-566f-4296-9ee1-de85fa2d4d84 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:40.756217 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-93d5b259-566f-4296-9ee1-de85fa2d4d84 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:40.765454 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93d5b259-566f-4296-9ee1-de85fa2d4d84 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:40.766299 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93d5b259-566f-4296-9ee1-de85fa2d4d84 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:40.766935 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93d5b259-566f-4296-9ee1-de85fa2d4d84 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:40.767840 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93d5b259-566f-4296-9ee1-de85fa2d4d84 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:40.768470 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93d5b259-566f-4296-9ee1-de85fa2d4d84 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:40.769332 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93d5b259-566f-4296-9ee1-de85fa2d4d84 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:40.973899 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-af153928-d0e6-43c8-97dd-aa0c5e4d5649 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:40.976119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-af153928-d0e6-43c8-97dd-aa0c5e4d5649 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:40.988440 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-af153928-d0e6-43c8-97dd-aa0c5e4d5649 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:40.988440 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-af153928-d0e6-43c8-97dd-aa0c5e4d5649 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:40.988763 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-af153928-d0e6-43c8-97dd-aa0c5e4d5649 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:40.989662 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-af153928-d0e6-43c8-97dd-aa0c5e4d5649 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:40.990292 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-af153928-d0e6-43c8-97dd-aa0c5e4d5649 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:40.991983 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-af153928-d0e6-43c8-97dd-aa0c5e4d5649 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:41.010022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-93d5b259-566f-4296-9ee1-de85fa2d4d84 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:41.023056 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-93d5b259-566f-4296-9ee1-de85fa2d4d84 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:41.023056 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-93d5b259-566f-4296-9ee1-de85fa2d4d84 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:41.029781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-93d5b259-566f-4296-9ee1-de85fa2d4d84 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1722 microversion: 2.20 time: 0.276031 Sep 16 08:12:41.030549 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 499/947] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:40 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1722 bytes in 284 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:41.042169 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-94f291a3-32b5-4043-9fc8-07ebd9418a2d req-732e663d-50c3-4974-8e0a-a3670968e6c5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a", "name": "network-vif-plugged", "status": "completed", "tag": "e24b0b86-8679-4330-a999-3826f76e950a"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:41.059977 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-94f291a3-32b5-4043-9fc8-07ebd9418a2d req-732e663d-50c3-4974-8e0a-a3670968e6c5 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:41.060849 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-94f291a3-32b5-4043-9fc8-07ebd9418a2d req-732e663d-50c3-4974-8e0a-a3670968e6c5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:41.061556 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-94f291a3-32b5-4043-9fc8-07ebd9418a2d req-732e663d-50c3-4974-8e0a-a3670968e6c5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:41.075361 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-94f291a3-32b5-4043-9fc8-07ebd9418a2d req-732e663d-50c3-4974-8e0a-a3670968e6c5 service nova] Creating event network-vif-plugged:e24b0b86-8679-4330-a999-3826f76e950a for instance dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a on hv-cinder-74014 Sep 16 08:12:41.083064 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-94f291a3-32b5-4043-9fc8-07ebd9418a2d req-732e663d-50c3-4974-8e0a-a3670968e6c5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.045191 Sep 16 08:12:41.084587 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 500/948] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:12:41 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 47 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:41.191835 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-af153928-d0e6-43c8-97dd-aa0c5e4d5649 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:41.200879 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-af153928-d0e6-43c8-97dd-aa0c5e4d5649 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1314 microversion: 2.1 time: 0.232721 Sep 16 08:12:41.201588 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 449/949] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:40 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1314 bytes in 234 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:42.058735 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-27ab8dc9-78f3-4e5e-be10-af6eb7060f53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:42.059530 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-27ab8dc9-78f3-4e5e-be10-af6eb7060f53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:42.066126 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27ab8dc9-78f3-4e5e-be10-af6eb7060f53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:42.066616 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27ab8dc9-78f3-4e5e-be10-af6eb7060f53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:42.067181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27ab8dc9-78f3-4e5e-be10-af6eb7060f53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:42.067978 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27ab8dc9-78f3-4e5e-be10-af6eb7060f53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:42.068701 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27ab8dc9-78f3-4e5e-be10-af6eb7060f53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:42.069855 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27ab8dc9-78f3-4e5e-be10-af6eb7060f53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:42.225914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-38de90da-ef20-42a6-abc1-5977819c1a3e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:42.226535 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-38de90da-ef20-42a6-abc1-5977819c1a3e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:42.233113 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-38de90da-ef20-42a6-abc1-5977819c1a3e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:42.233595 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-38de90da-ef20-42a6-abc1-5977819c1a3e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:42.234035 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-38de90da-ef20-42a6-abc1-5977819c1a3e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:42.234754 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-38de90da-ef20-42a6-abc1-5977819c1a3e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:42.235220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-38de90da-ef20-42a6-abc1-5977819c1a3e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:42.235647 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-38de90da-ef20-42a6-abc1-5977819c1a3e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:42.282850 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-27ab8dc9-78f3-4e5e-be10-af6eb7060f53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:42.299397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-27ab8dc9-78f3-4e5e-be10-af6eb7060f53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:42.306195 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-27ab8dc9-78f3-4e5e-be10-af6eb7060f53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:42.307929 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-27ab8dc9-78f3-4e5e-be10-af6eb7060f53 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1722 microversion: 2.20 time: 0.253960 Sep 16 08:12:42.309139 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 501/950] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:42 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1722 bytes in 256 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:42.465924 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-38de90da-ef20-42a6-abc1-5977819c1a3e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:42.481764 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-38de90da-ef20-42a6-abc1-5977819c1a3e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1314 microversion: 2.1 time: 0.259655 Sep 16 08:12:42.494735 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 450/951] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:42 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1314 bytes in 267 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:12:43.112086 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-1de37fc8-ed4a-4412-aee9-c5c89af76690 req-409317e8-cc42-4745-b98f-5766de20885e service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6b33b5-7327-4c2f-ae74-6f718e860360", "name": "network-vif-unplugged", "status": "completed", "tag": "24fc5230-45b4-476e-ae08-dc736c4339d1"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:43.122074 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-1de37fc8-ed4a-4412-aee9-c5c89af76690 req-409317e8-cc42-4745-b98f-5766de20885e service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:43.122551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-1de37fc8-ed4a-4412-aee9-c5c89af76690 req-409317e8-cc42-4745-b98f-5766de20885e service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:43.123004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-1de37fc8-ed4a-4412-aee9-c5c89af76690 req-409317e8-cc42-4745-b98f-5766de20885e service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:43.134212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-1de37fc8-ed4a-4412-aee9-c5c89af76690 req-409317e8-cc42-4745-b98f-5766de20885e service nova] Creating event network-vif-unplugged:24fc5230-45b4-476e-ae08-dc736c4339d1 for instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 on hv-cinder-74014 Sep 16 08:12:43.138969 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-1de37fc8-ed4a-4412-aee9-c5c89af76690 req-409317e8-cc42-4745-b98f-5766de20885e service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 185 microversion: 2.1 time: 0.030509 Sep 16 08:12:43.139565 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 502/952] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:12:43 2022] POST /compute/v2.1/os-server-external-events => generated 185 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:43.339040 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-af26ee8e-3ecb-4273-a743-b63fe509d76f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:43.339715 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-af26ee8e-3ecb-4273-a743-b63fe509d76f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:43.346269 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-af26ee8e-3ecb-4273-a743-b63fe509d76f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:43.346793 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-af26ee8e-3ecb-4273-a743-b63fe509d76f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:43.347235 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-af26ee8e-3ecb-4273-a743-b63fe509d76f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:43.349806 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-af26ee8e-3ecb-4273-a743-b63fe509d76f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:43.349806 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-af26ee8e-3ecb-4273-a743-b63fe509d76f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:43.349806 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-af26ee8e-3ecb-4273-a743-b63fe509d76f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:43.479690 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-af26ee8e-3ecb-4273-a743-b63fe509d76f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:43.488356 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-af26ee8e-3ecb-4273-a743-b63fe509d76f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:43.492967 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-af26ee8e-3ecb-4273-a743-b63fe509d76f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:43.492967 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-af26ee8e-3ecb-4273-a743-b63fe509d76f tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1725 microversion: 2.20 time: 0.156715 Sep 16 08:12:43.492967 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 451/953] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:43 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1725 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:43.516513 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-021c6d7b-f436-4a3d-a1e1-75c3952c5ead tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "a620c0be-f81b-4d8f-ba4c-9632dce76eb5"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:43.518207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ed2ef053-fc5e-4d1a-89a1-a4646e50350b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:43.518997 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ed2ef053-fc5e-4d1a-89a1-a4646e50350b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:43.521750 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-021c6d7b-f436-4a3d-a1e1-75c3952c5ead tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:43.527843 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-021c6d7b-f436-4a3d-a1e1-75c3952c5ead tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:43.529099 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-021c6d7b-f436-4a3d-a1e1-75c3952c5ead tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:43.530126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-021c6d7b-f436-4a3d-a1e1-75c3952c5ead tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:43.531909 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-021c6d7b-f436-4a3d-a1e1-75c3952c5ead tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:43.532541 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-021c6d7b-f436-4a3d-a1e1-75c3952c5ead tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:43.533976 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-021c6d7b-f436-4a3d-a1e1-75c3952c5ead tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:43.534511 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ed2ef053-fc5e-4d1a-89a1-a4646e50350b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:43.535453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ed2ef053-fc5e-4d1a-89a1-a4646e50350b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:43.535942 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ed2ef053-fc5e-4d1a-89a1-a4646e50350b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:43.536952 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ed2ef053-fc5e-4d1a-89a1-a4646e50350b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:43.537506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ed2ef053-fc5e-4d1a-89a1-a4646e50350b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:43.537962 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ed2ef053-fc5e-4d1a-89a1-a4646e50350b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:43.679051 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ed2ef053-fc5e-4d1a-89a1-a4646e50350b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:43.687192 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ed2ef053-fc5e-4d1a-89a1-a4646e50350b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1314 microversion: 2.1 time: 0.179287 Sep 16 08:12:43.687773 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 503/954] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:43 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1314 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:43.708065 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-1107665196", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "networks": [{"uuid": "bc4f5dfd-e75f-417b-a277-edb3999f1a95"}]}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:43.768343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.network.neutron [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] validate_networks() for [('bc4f5dfd-e75f-417b-a277-edb3999f1a95', None, None, None, None, None)] {{(pid=121046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:12:44.388815 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Flavor limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:12:44.389426 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Image limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:12:44.390053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Flavor pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:12:44.390476 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Image pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:12:44.390958 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:12:44.401216 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:44.401706 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:44.402157 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:44.402984 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:44.403706 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:44.404310 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:44.422599 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Getting quotas for project e3276981b48d4974841dd97ee1cb9882. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:12:44.426811 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Getting quotas for user cc14169c8f7044c6815944af5bc658a9 and project e3276981b48d4974841dd97ee1cb9882. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:12:44.437786 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Going to run 1 instances... {{(pid=121046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:12:44.440157 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:12:44.609078 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-760957c3-1533-4f48-a674-0241ba743fa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.905210 Sep 16 08:12:44.609890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 504/955] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:12:43 2022] POST /compute/v2.1/servers => generated 380 bytes in 921 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:12:44.621566 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3f13ea9e-817a-40a0-86cd-15efc1540c45 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:44.622192 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3f13ea9e-817a-40a0-86cd-15efc1540c45 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:44.665439 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-021c6d7b-f436-4a3d-a1e1-75c3952c5ead tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "POST /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/os-volume_attachments" status: 200 len: 188 microversion: 2.20 time: 1.120536 Sep 16 08:12:44.665439 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 452/956] 10.222.0.59 () {62 vars in 1364 bytes} [Fri Sep 16 08:12:43 2022] POST /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/os-volume_attachments => generated 188 bytes in 1122 msecs (HTTP/1.1 200) 9 headers in 359 bytes (1 switches on core 0) Sep 16 08:12:44.690215 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3f13ea9e-817a-40a0-86cd-15efc1540c45 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:44.698309 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3f13ea9e-817a-40a0-86cd-15efc1540c45 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1219 microversion: 2.1 time: 0.080822 Sep 16 08:12:44.711503 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 505/957] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:44 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1219 bytes in 83 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:44.716352 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-eac6494d-d833-449a-8f70-c79a8ff95594 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:44.717057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-eac6494d-d833-449a-8f70-c79a8ff95594 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:44.728997 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eac6494d-d833-449a-8f70-c79a8ff95594 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:44.729803 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eac6494d-d833-449a-8f70-c79a8ff95594 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:44.730252 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eac6494d-d833-449a-8f70-c79a8ff95594 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:44.730998 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eac6494d-d833-449a-8f70-c79a8ff95594 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:44.731464 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eac6494d-d833-449a-8f70-c79a8ff95594 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:44.731967 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-eac6494d-d833-449a-8f70-c79a8ff95594 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:44.839536 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-91e2cbfe-0d22-4879-ba99-2ea17ddb1a73 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:44.840371 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-91e2cbfe-0d22-4879-ba99-2ea17ddb1a73 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:44.847569 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91e2cbfe-0d22-4879-ba99-2ea17ddb1a73 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:44.848393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91e2cbfe-0d22-4879-ba99-2ea17ddb1a73 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:44.849095 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91e2cbfe-0d22-4879-ba99-2ea17ddb1a73 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:44.850136 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91e2cbfe-0d22-4879-ba99-2ea17ddb1a73 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:44.850859 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91e2cbfe-0d22-4879-ba99-2ea17ddb1a73 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:44.851523 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91e2cbfe-0d22-4879-ba99-2ea17ddb1a73 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:44.895192 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-eac6494d-d833-449a-8f70-c79a8ff95594 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:44.899806 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-eac6494d-d833-449a-8f70-c79a8ff95594 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1497 microversion: 2.1 time: 0.187386 Sep 16 08:12:44.900486 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 453/958] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:44 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1497 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:12:45.467811 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-91e2cbfe-0d22-4879-ba99-2ea17ddb1a73 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/os-volume_attachments/a620c0be-f81b-4d8f-ba4c-9632dce76eb5" status: 202 len: 0 microversion: 2.20 time: 0.633493 Sep 16 08:12:45.468453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 506/959] 10.222.0.59 () {60 vars in 1457 bytes} [Fri Sep 16 08:12:44 2022] DELETE /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/os-volume_attachments/a620c0be-f81b-4d8f-ba4c-9632dce76eb5 => generated 0 bytes in 635 msecs (HTTP/1.1 202) 9 headers in 363 bytes (2 switches on core 0) Sep 16 08:12:45.542433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b1a6a5be-cadc-42bb-85de-66f68d3a8d4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:45.543049 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b1a6a5be-cadc-42bb-85de-66f68d3a8d4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:45.549914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b1a6a5be-cadc-42bb-85de-66f68d3a8d4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:45.550381 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b1a6a5be-cadc-42bb-85de-66f68d3a8d4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:45.551013 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b1a6a5be-cadc-42bb-85de-66f68d3a8d4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:45.551712 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b1a6a5be-cadc-42bb-85de-66f68d3a8d4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:45.552166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b1a6a5be-cadc-42bb-85de-66f68d3a8d4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:45.552592 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b1a6a5be-cadc-42bb-85de-66f68d3a8d4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:45.584471 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b1a6a5be-cadc-42bb-85de-66f68d3a8d4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121047) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 08:12:45.730097 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2090d683-c295-4b96-afd3-a07546a5fd67 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:45.730738 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2090d683-c295-4b96-afd3-a07546a5fd67 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:45.740191 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2090d683-c295-4b96-afd3-a07546a5fd67 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:45.740191 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2090d683-c295-4b96-afd3-a07546a5fd67 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:45.741631 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2090d683-c295-4b96-afd3-a07546a5fd67 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:45.742195 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2090d683-c295-4b96-afd3-a07546a5fd67 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:45.742695 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2090d683-c295-4b96-afd3-a07546a5fd67 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:45.743136 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2090d683-c295-4b96-afd3-a07546a5fd67 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:45.813766 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2090d683-c295-4b96-afd3-a07546a5fd67 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:45.823837 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2090d683-c295-4b96-afd3-a07546a5fd67 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1223 microversion: 2.1 time: 0.097595 Sep 16 08:12:45.827128 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 507/960] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:45 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1223 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:12:45.832052 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c1aa96d9-66d5-45be-9abe-57995d088229 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:45.832764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c1aa96d9-66d5-45be-9abe-57995d088229 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:45.839558 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c1aa96d9-66d5-45be-9abe-57995d088229 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:45.840323 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c1aa96d9-66d5-45be-9abe-57995d088229 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:45.840978 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c1aa96d9-66d5-45be-9abe-57995d088229 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:45.841924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c1aa96d9-66d5-45be-9abe-57995d088229 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:45.842607 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c1aa96d9-66d5-45be-9abe-57995d088229 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:45.843219 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c1aa96d9-66d5-45be-9abe-57995d088229 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:45.871809 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c1aa96d9-66d5-45be-9abe-57995d088229 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:12:45.872231 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b1a6a5be-cadc-42bb-85de-66f68d3a8d4b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "POST /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/action" status: 202 len: 0 microversion: 2.20 time: 0.333663 Sep 16 08:12:45.873549 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 454/961] 10.222.0.59 () {62 vars in 1319 bytes} [Fri Sep 16 08:12:45 2022] POST /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/action => generated 0 bytes in 342 msecs (HTTP/1.1 202) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:12:45.883074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b98489e1-1acf-4774-a20c-a1bcbe391b50 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:45.883627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b98489e1-1acf-4774-a20c-a1bcbe391b50 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:45.891045 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b98489e1-1acf-4774-a20c-a1bcbe391b50 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:45.891531 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b98489e1-1acf-4774-a20c-a1bcbe391b50 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:45.896672 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b98489e1-1acf-4774-a20c-a1bcbe391b50 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:45.896672 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b98489e1-1acf-4774-a20c-a1bcbe391b50 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:45.896672 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b98489e1-1acf-4774-a20c-a1bcbe391b50 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:45.896672 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b98489e1-1acf-4774-a20c-a1bcbe391b50 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:46.009878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=93,nova_cell1:INSERT=2,nova_cell1:UPDATE=5 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:46.071007 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1,nova_api:INSERT=6,nova_api:DELETE=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:46.122386 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b98489e1-1acf-4774-a20c-a1bcbe391b50 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:46.130509 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b98489e1-1acf-4774-a20c-a1bcbe391b50 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:46.132148 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b98489e1-1acf-4774-a20c-a1bcbe391b50 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:46.133390 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b98489e1-1acf-4774-a20c-a1bcbe391b50 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1673 microversion: 2.20 time: 0.255248 Sep 16 08:12:46.134020 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 455/962] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:45 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1673 bytes in 257 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:46.200084 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c1aa96d9-66d5-45be-9abe-57995d088229 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "DELETE /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 204 len: 0 microversion: 2.1 time: 0.371457 Sep 16 08:12:46.200679 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 508/963] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:12:45 2022] DELETE /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 0 bytes in 373 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:12:46.208972 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b1d53d4c-5e91-4255-8315-e80a41b934b3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:46.209576 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b1d53d4c-5e91-4255-8315-e80a41b934b3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:46.215776 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b1d53d4c-5e91-4255-8315-e80a41b934b3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:46.216256 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b1d53d4c-5e91-4255-8315-e80a41b934b3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:46.216692 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b1d53d4c-5e91-4255-8315-e80a41b934b3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:46.217387 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b1d53d4c-5e91-4255-8315-e80a41b934b3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:46.218023 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b1d53d4c-5e91-4255-8315-e80a41b934b3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:46.218450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b1d53d4c-5e91-4255-8315-e80a41b934b3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:46.417613 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b1d53d4c-5e91-4255-8315-e80a41b934b3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:46.425545 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b1d53d4c-5e91-4255-8315-e80a41b934b3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1503 microversion: 2.1 time: 0.220451 Sep 16 08:12:46.426117 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 456/964] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:46 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1503 bytes in 222 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:46.852529 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a0f7dba7-18c9-4e72-be77-7966fb3921fa tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:46.859103 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a0f7dba7-18c9-4e72-be77-7966fb3921fa tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:46.868465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a0f7dba7-18c9-4e72-be77-7966fb3921fa tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:46.870419 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a0f7dba7-18c9-4e72-be77-7966fb3921fa tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:46.870419 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a0f7dba7-18c9-4e72-be77-7966fb3921fa tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:46.871297 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a0f7dba7-18c9-4e72-be77-7966fb3921fa tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:46.871763 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a0f7dba7-18c9-4e72-be77-7966fb3921fa tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:46.872434 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a0f7dba7-18c9-4e72-be77-7966fb3921fa tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:46.938255 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a0f7dba7-18c9-4e72-be77-7966fb3921fa tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:46.946298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a0f7dba7-18c9-4e72-be77-7966fb3921fa tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1271 microversion: 2.1 time: 0.098582 Sep 16 08:12:46.946889 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 509/965] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:46 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1271 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:47.160318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7366eba0-9c03-4c55-ab6d-8e2fa3eedb61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:47.160829 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7366eba0-9c03-4c55-ab6d-8e2fa3eedb61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:47.168216 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7366eba0-9c03-4c55-ab6d-8e2fa3eedb61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:47.168216 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7366eba0-9c03-4c55-ab6d-8e2fa3eedb61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:47.168447 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7366eba0-9c03-4c55-ab6d-8e2fa3eedb61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:47.168935 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7366eba0-9c03-4c55-ab6d-8e2fa3eedb61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:47.169387 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7366eba0-9c03-4c55-ab6d-8e2fa3eedb61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:47.169818 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7366eba0-9c03-4c55-ab6d-8e2fa3eedb61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:47.305305 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7366eba0-9c03-4c55-ab6d-8e2fa3eedb61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:47.313319 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7366eba0-9c03-4c55-ab6d-8e2fa3eedb61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:47.314777 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7366eba0-9c03-4c55-ab6d-8e2fa3eedb61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:47.315929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7366eba0-9c03-4c55-ab6d-8e2fa3eedb61 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1673 microversion: 2.20 time: 0.159660 Sep 16 08:12:47.316480 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 457/966] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:47 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1673 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:47.450180 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b3385abb-1f81-48d1-8627-abedea4d0614 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:47.451056 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b3385abb-1f81-48d1-8627-abedea4d0614 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:47.459390 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b3385abb-1f81-48d1-8627-abedea4d0614 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:47.459878 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b3385abb-1f81-48d1-8627-abedea4d0614 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:47.460315 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b3385abb-1f81-48d1-8627-abedea4d0614 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:47.461015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b3385abb-1f81-48d1-8627-abedea4d0614 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:47.461472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b3385abb-1f81-48d1-8627-abedea4d0614 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:47.461898 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b3385abb-1f81-48d1-8627-abedea4d0614 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:47.598907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b3385abb-1f81-48d1-8627-abedea4d0614 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:47.608313 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b3385abb-1f81-48d1-8627-abedea4d0614 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1503 microversion: 2.1 time: 0.161776 Sep 16 08:12:47.608901 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 510/967] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:47 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1503 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:47.969502 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-de479381-6e4a-4e23-a0f9-9cca2febefe7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:47.970307 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-de479381-6e4a-4e23-a0f9-9cca2febefe7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:47.976867 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-de479381-6e4a-4e23-a0f9-9cca2febefe7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:47.977462 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-de479381-6e4a-4e23-a0f9-9cca2febefe7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:47.977962 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-de479381-6e4a-4e23-a0f9-9cca2febefe7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:47.978750 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-de479381-6e4a-4e23-a0f9-9cca2febefe7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:47.979277 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-de479381-6e4a-4e23-a0f9-9cca2febefe7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:47.979770 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-de479381-6e4a-4e23-a0f9-9cca2febefe7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:48.049738 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-de479381-6e4a-4e23-a0f9-9cca2febefe7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:48.059138 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-de479381-6e4a-4e23-a0f9-9cca2febefe7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1271 microversion: 2.1 time: 0.093532 Sep 16 08:12:48.070749 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 458/968] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:47 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1271 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:48.343370 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1d23032e-404b-4b62-8151-77e7a37ba957 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:48.344905 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1d23032e-404b-4b62-8151-77e7a37ba957 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:48.353188 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1d23032e-404b-4b62-8151-77e7a37ba957 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:48.353789 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1d23032e-404b-4b62-8151-77e7a37ba957 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:48.354487 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1d23032e-404b-4b62-8151-77e7a37ba957 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:48.355309 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1d23032e-404b-4b62-8151-77e7a37ba957 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:48.355830 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1d23032e-404b-4b62-8151-77e7a37ba957 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:48.356261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1d23032e-404b-4b62-8151-77e7a37ba957 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:48.504499 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1d23032e-404b-4b62-8151-77e7a37ba957 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:48.514254 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1d23032e-404b-4b62-8151-77e7a37ba957 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:48.516137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1d23032e-404b-4b62-8151-77e7a37ba957 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:48.517602 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1d23032e-404b-4b62-8151-77e7a37ba957 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1675 microversion: 2.20 time: 0.179179 Sep 16 08:12:48.518227 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 511/969] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:48 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1675 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:48.640481 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ea05511f-c1d6-4905-b96b-c2da8e87a99d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:48.641134 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ea05511f-c1d6-4905-b96b-c2da8e87a99d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:48.649579 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ea05511f-c1d6-4905-b96b-c2da8e87a99d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:48.650072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ea05511f-c1d6-4905-b96b-c2da8e87a99d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:48.650517 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ea05511f-c1d6-4905-b96b-c2da8e87a99d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:48.651255 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ea05511f-c1d6-4905-b96b-c2da8e87a99d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:48.651712 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ea05511f-c1d6-4905-b96b-c2da8e87a99d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:48.652144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ea05511f-c1d6-4905-b96b-c2da8e87a99d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:48.664286 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=91,nova_cell1:INSERT=4,nova_cell1:UPDATE=5 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:48.869926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ea05511f-c1d6-4905-b96b-c2da8e87a99d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:48.888225 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ea05511f-c1d6-4905-b96b-c2da8e87a99d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1503 microversion: 2.1 time: 0.259682 Sep 16 08:12:48.902708 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 459/970] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:48 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1503 bytes in 261 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:48.948332 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-04502b08-91c7-46ee-b058-ef2f7b77f68a req-fd6141fe-9a2f-43ae-a333-60989e84c046 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a", "name": "network-vif-deleted", "tag": "e24b0b86-8679-4330-a999-3826f76e950a"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:48.960510 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-04502b08-91c7-46ee-b058-ef2f7b77f68a req-fd6141fe-9a2f-43ae-a333-60989e84c046 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:48.963541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-04502b08-91c7-46ee-b058-ef2f7b77f68a req-fd6141fe-9a2f-43ae-a333-60989e84c046 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:48.963541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-04502b08-91c7-46ee-b058-ef2f7b77f68a req-fd6141fe-9a2f-43ae-a333-60989e84c046 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:48.977768 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-04502b08-91c7-46ee-b058-ef2f7b77f68a req-fd6141fe-9a2f-43ae-a333-60989e84c046 service nova] Creating event network-vif-deleted:e24b0b86-8679-4330-a999-3826f76e950a for instance dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a on hv-cinder-74014 Sep 16 08:12:48.985609 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-04502b08-91c7-46ee-b058-ef2f7b77f68a req-fd6141fe-9a2f-43ae-a333-60989e84c046 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.041435 Sep 16 08:12:48.989602 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 512/971] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:12:48 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 43 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:49.082655 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-002a296c-24a7-40f0-b5e0-4af917aa08e0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:49.083287 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-002a296c-24a7-40f0-b5e0-4af917aa08e0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:49.093409 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-002a296c-24a7-40f0-b5e0-4af917aa08e0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:49.095484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-002a296c-24a7-40f0-b5e0-4af917aa08e0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:49.097782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-002a296c-24a7-40f0-b5e0-4af917aa08e0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:49.100214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-002a296c-24a7-40f0-b5e0-4af917aa08e0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:49.101757 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-002a296c-24a7-40f0-b5e0-4af917aa08e0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:49.102594 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-002a296c-24a7-40f0-b5e0-4af917aa08e0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:49.243144 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-002a296c-24a7-40f0-b5e0-4af917aa08e0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:49.251796 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-002a296c-24a7-40f0-b5e0-4af917aa08e0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1277 microversion: 2.1 time: 0.173567 Sep 16 08:12:49.252823 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 460/972] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:49 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1277 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:12:49.544808 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e38d5368-3395-4a27-888a-b61c67c25031 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:49.545502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e38d5368-3395-4a27-888a-b61c67c25031 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:49.552341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e38d5368-3395-4a27-888a-b61c67c25031 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:49.553330 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e38d5368-3395-4a27-888a-b61c67c25031 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:49.553754 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e38d5368-3395-4a27-888a-b61c67c25031 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:49.554453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e38d5368-3395-4a27-888a-b61c67c25031 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:49.554959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e38d5368-3395-4a27-888a-b61c67c25031 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:49.555418 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e38d5368-3395-4a27-888a-b61c67c25031 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:49.863339 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e38d5368-3395-4a27-888a-b61c67c25031 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:49.873493 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e38d5368-3395-4a27-888a-b61c67c25031 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:49.875305 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e38d5368-3395-4a27-888a-b61c67c25031 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:49.876994 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e38d5368-3395-4a27-888a-b61c67c25031 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.336497 Sep 16 08:12:49.878265 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 513/973] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:49 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 338 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:49.914607 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:49.915250 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:49.921822 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:49.922329 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:49.923105 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:49.923987 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:49.924445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:49.924898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:49.956303 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:49.956780 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:49.957446 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:49.957889 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lazy-loading 'fault' on Instance uuid dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:12:49.998956 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:50.007502 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a856d856-a621-4677-bb85-22c243f6882f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 200 len: 1304 microversion: 2.1 time: 0.097360 Sep 16 08:12:50.011816 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 461/974] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:49 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 1304 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:50.284032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2b337f46-6858-42a8-a06e-288af609e7b3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:50.284776 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2b337f46-6858-42a8-a06e-288af609e7b3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:50.291714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b337f46-6858-42a8-a06e-288af609e7b3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:50.292655 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b337f46-6858-42a8-a06e-288af609e7b3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:50.293228 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b337f46-6858-42a8-a06e-288af609e7b3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:50.294321 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b337f46-6858-42a8-a06e-288af609e7b3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:50.301713 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b337f46-6858-42a8-a06e-288af609e7b3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:50.301713 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b337f46-6858-42a8-a06e-288af609e7b3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:50.562184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2b337f46-6858-42a8-a06e-288af609e7b3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:50.570421 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2b337f46-6858-42a8-a06e-288af609e7b3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1319 microversion: 2.1 time: 0.290541 Sep 16 08:12:50.571570 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 514/975] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:50 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1319 bytes in 292 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:50.905510 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-030747df-a579-433b-8b32-58638ec03e4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:50.906489 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-030747df-a579-433b-8b32-58638ec03e4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:50.918653 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-030747df-a579-433b-8b32-58638ec03e4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:50.923265 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-030747df-a579-433b-8b32-58638ec03e4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:50.923265 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-030747df-a579-433b-8b32-58638ec03e4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:50.923265 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-030747df-a579-433b-8b32-58638ec03e4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:50.923265 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-030747df-a579-433b-8b32-58638ec03e4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:50.923915 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-030747df-a579-433b-8b32-58638ec03e4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:50.949889 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-979b27c8-f318-4e4f-bb1b-403c2f2995a4 req-ab1f670f-44b5-4bac-80ef-44ea1b0c760a service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "8e9494f9-9706-4af0-b4ef-dac0291aae29", "tag": "cccafc8a-5a37-4427-8386-89051058ea81"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:50.970795 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-979b27c8-f318-4e4f-bb1b-403c2f2995a4 req-ab1f670f-44b5-4bac-80ef-44ea1b0c760a service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:50.971663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-979b27c8-f318-4e4f-bb1b-403c2f2995a4 req-ab1f670f-44b5-4bac-80ef-44ea1b0c760a service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.005s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:50.978462 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-979b27c8-f318-4e4f-bb1b-403c2f2995a4 req-ab1f670f-44b5-4bac-80ef-44ea1b0c760a service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:51.004033 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-979b27c8-f318-4e4f-bb1b-403c2f2995a4 req-ab1f670f-44b5-4bac-80ef-44ea1b0c760a service nova] Creating event network-changed:cccafc8a-5a37-4427-8386-89051058ea81 for instance 8e9494f9-9706-4af0-b4ef-dac0291aae29 on hv-cinder-74014 Sep 16 08:12:51.041519 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-979b27c8-f318-4e4f-bb1b-403c2f2995a4 req-ab1f670f-44b5-4bac-80ef-44ea1b0c760a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.098691 Sep 16 08:12:51.043961 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 515/976] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:12:50 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 357 bytes (3 switches on core 0) Sep 16 08:12:51.057001 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e9ae97f8-fcfe-4c90-9085-44f17faee89e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:51.061261 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e9ae97f8-fcfe-4c90-9085-44f17faee89e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:51.069043 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e9ae97f8-fcfe-4c90-9085-44f17faee89e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:51.069537 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e9ae97f8-fcfe-4c90-9085-44f17faee89e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:51.076538 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e9ae97f8-fcfe-4c90-9085-44f17faee89e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.007s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:51.077313 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e9ae97f8-fcfe-4c90-9085-44f17faee89e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:51.079880 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e9ae97f8-fcfe-4c90-9085-44f17faee89e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:51.080446 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e9ae97f8-fcfe-4c90-9085-44f17faee89e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:51.103002 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-e9ae97f8-fcfe-4c90-9085-44f17faee89e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] HTTP exception thrown: Instance dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a could not be found. Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e9ae97f8-fcfe-4c90-9085-44f17faee89e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Request method failure captured: Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a HTTP/1.1 Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC_oOwjFQGk1XNqaFO84XWJk7DcugU0YHHuAAS-Qz_B5LhmG--Tyz874eWyKwQrVLwN_jqGiXEymgIrd-9nTjpesSCC6SBG6x1d-UI4BaJQILhDYoQJ-Fb9lD6GGo80lwazq3y-kNC68ri9WDhzz36z3tuba8MagbyXOt8amsPzFgw8 Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 9d32f40c2bd64a61aadd27f82d11191a Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-VolumesActionsTest-878094391 Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:12:51.104804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:12:51.106820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9d32f40c2bd64a61aadd27f82d11191a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9d32f40c2bd64a61aadd27f82d11191a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9d32f40c2bd64a61aadd27f82d11191a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9d32f40c2bd64a61aadd27f82d11191a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:12:51.106820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-VolumesActionsTest-878094391 Sep 16 08:12:51.106820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 9d32f40c2bd64a61aadd27f82d11191a Sep 16 08:12:51.106820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-VolumesActionsTest-878094391 Sep 16 08:12:51.106820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-VolumesActionsTest-878094391-project Sep 16 08:12:51.106820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:12:51.106820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:12:51.106820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: e9cd1b533aa8456d95e1bdbeac678b9f Sep 16 08:12:51.106820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-VolumesActionsTest-878094391-project Sep 16 08:12:51.106820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:12:51.106820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a could not be found. Sep 16 08:12:51.106820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': 'dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a'} Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a could not be found. Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:12:51.107834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a could not be found. Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a could not be found. Sep 16 08:12:51.109862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:12:51.111330 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e9ae97f8-fcfe-4c90-9085-44f17faee89e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Returning 404 to user: Instance dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:12:51.111330 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e9ae97f8-fcfe-4c90-9085-44f17faee89e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a" status: 404 len: 111 microversion: 2.1 time: 0.063149 Sep 16 08:12:51.111643 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 516/977] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:51 2022] GET /compute/v2.1/servers/dd9eb5e0-b06a-4c5c-b6a1-440d96c0932a => generated 111 bytes in 67 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:12:51.248639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-030747df-a579-433b-8b32-58638ec03e4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:51.262368 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-030747df-a579-433b-8b32-58638ec03e4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:51.264262 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-030747df-a579-433b-8b32-58638ec03e4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:51.266448 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-030747df-a579-433b-8b32-58638ec03e4a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.366469 Sep 16 08:12:51.280733 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 462/978] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:50 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 380 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:51.348155 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesActionsTest-instance-1051991909", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "networks": [{"uuid": "a4c3bd05-db62-48c3-84ab-0949df8a6728"}]}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:51.436085 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.network.neutron [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] validate_networks() for [('a4c3bd05-db62-48c3-84ab-0949df8a6728', None, None, None, None, None)] {{(pid=121046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:12:51.593315 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-78a9c5ff-a7d8-46d4-89ca-828debeb6c86 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:51.594361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-78a9c5ff-a7d8-46d4-89ca-828debeb6c86 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:51.600736 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-78a9c5ff-a7d8-46d4-89ca-828debeb6c86 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:51.601495 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-78a9c5ff-a7d8-46d4-89ca-828debeb6c86 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:51.602124 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-78a9c5ff-a7d8-46d4-89ca-828debeb6c86 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:51.603034 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-78a9c5ff-a7d8-46d4-89ca-828debeb6c86 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:51.603894 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-78a9c5ff-a7d8-46d4-89ca-828debeb6c86 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:51.604610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-78a9c5ff-a7d8-46d4-89ca-828debeb6c86 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:51.780118 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-78a9c5ff-a7d8-46d4-89ca-828debeb6c86 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:51.791087 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-78a9c5ff-a7d8-46d4-89ca-828debeb6c86 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1319 microversion: 2.1 time: 0.201029 Sep 16 08:12:51.792184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 463/979] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:51 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1319 bytes in 203 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:12:52.154466 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Flavor limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:12:52.154998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Image limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:12:52.158092 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Flavor pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:12:52.158092 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Image pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:12:52.158092 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:12:52.169930 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:52.170898 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:52.171411 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:52.172302 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:52.173045 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:52.173745 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:52.211410 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Getting quotas for project 9d32f40c2bd64a61aadd27f82d11191a. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:12:52.228322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Getting quotas for user e9cd1b533aa8456d95e1bdbeac678b9f and project 9d32f40c2bd64a61aadd27f82d11191a. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:12:52.262314 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Going to run 1 instances... {{(pid=121046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:12:52.264771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:12:52.292694 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-53eea6b7-499b-4975-8179-7b8338208855 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:52.293421 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-53eea6b7-499b-4975-8179-7b8338208855 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:52.309531 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-53eea6b7-499b-4975-8179-7b8338208855 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:52.310321 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-53eea6b7-499b-4975-8179-7b8338208855 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:52.310971 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-53eea6b7-499b-4975-8179-7b8338208855 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:52.311862 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-53eea6b7-499b-4975-8179-7b8338208855 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:52.312501 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-53eea6b7-499b-4975-8179-7b8338208855 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:52.313110 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-53eea6b7-499b-4975-8179-7b8338208855 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:52.421468 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-00379404-a10f-446f-ad48-626ecb4411b5 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 1.081079 Sep 16 08:12:52.422147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 517/980] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:12:51 2022] POST /compute/v2.1/servers => generated 380 bytes in 1082 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:12:52.434341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e0a15ae2-6ea0-42a1-a79b-5c9745839fdf tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:52.434991 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e0a15ae2-6ea0-42a1-a79b-5c9745839fdf tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:52.484117 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-53eea6b7-499b-4975-8179-7b8338208855 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:52.493350 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-53eea6b7-499b-4975-8179-7b8338208855 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:52.496709 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-53eea6b7-499b-4975-8179-7b8338208855 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:52.497985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-53eea6b7-499b-4975-8179-7b8338208855 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.209514 Sep 16 08:12:52.498544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 464/981] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:52 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 211 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:12:52.518196 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e0a15ae2-6ea0-42a1-a79b-5c9745839fdf tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:52.530214 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e0a15ae2-6ea0-42a1-a79b-5c9745839fdf tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1214 microversion: 2.1 time: 0.099733 Sep 16 08:12:52.534759 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 518/982] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:52 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1214 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:12:52.817455 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2cdbc8e9-6b52-4695-8857-2bbf0279fc31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:52.818076 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2cdbc8e9-6b52-4695-8857-2bbf0279fc31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:52.824198 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2cdbc8e9-6b52-4695-8857-2bbf0279fc31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:52.824690 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2cdbc8e9-6b52-4695-8857-2bbf0279fc31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:52.825199 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2cdbc8e9-6b52-4695-8857-2bbf0279fc31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:52.825903 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2cdbc8e9-6b52-4695-8857-2bbf0279fc31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:52.826365 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2cdbc8e9-6b52-4695-8857-2bbf0279fc31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:52.826831 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2cdbc8e9-6b52-4695-8857-2bbf0279fc31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:52.960719 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2cdbc8e9-6b52-4695-8857-2bbf0279fc31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:52.968274 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2cdbc8e9-6b52-4695-8857-2bbf0279fc31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1319 microversion: 2.1 time: 0.154835 Sep 16 08:12:52.968839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 465/983] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:52 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1319 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:53.523659 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e7cd1930-e89d-424f-b6c7-461bd5695cf1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:53.525208 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e7cd1930-e89d-424f-b6c7-461bd5695cf1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:53.535040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e7cd1930-e89d-424f-b6c7-461bd5695cf1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:53.535040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e7cd1930-e89d-424f-b6c7-461bd5695cf1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:53.535040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e7cd1930-e89d-424f-b6c7-461bd5695cf1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:53.535764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e7cd1930-e89d-424f-b6c7-461bd5695cf1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:53.536585 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e7cd1930-e89d-424f-b6c7-461bd5695cf1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:53.537461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e7cd1930-e89d-424f-b6c7-461bd5695cf1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:53.573357 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-20fdcfc9-8f78-4116-9414-89795dc369f3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:53.574764 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-20fdcfc9-8f78-4116-9414-89795dc369f3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:53.583428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-20fdcfc9-8f78-4116-9414-89795dc369f3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:53.584283 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-20fdcfc9-8f78-4116-9414-89795dc369f3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:53.584900 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-20fdcfc9-8f78-4116-9414-89795dc369f3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:53.585768 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-20fdcfc9-8f78-4116-9414-89795dc369f3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:53.586379 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-20fdcfc9-8f78-4116-9414-89795dc369f3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:53.587079 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-20fdcfc9-8f78-4116-9414-89795dc369f3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:53.680311 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-20fdcfc9-8f78-4116-9414-89795dc369f3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:53.690039 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-20fdcfc9-8f78-4116-9414-89795dc369f3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1218 microversion: 2.1 time: 0.136848 Sep 16 08:12:53.708384 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 466/984] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:53 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1218 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:12:53.780951 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e7cd1930-e89d-424f-b6c7-461bd5695cf1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:53.794534 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e7cd1930-e89d-424f-b6c7-461bd5695cf1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:53.796048 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e7cd1930-e89d-424f-b6c7-461bd5695cf1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:53.798639 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e7cd1930-e89d-424f-b6c7-461bd5695cf1 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.278402 Sep 16 08:12:53.799968 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 519/985] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:53 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:53.990459 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ecee5019-b54d-41bd-8a0a-a46d6945d144 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:53.991657 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ecee5019-b54d-41bd-8a0a-a46d6945d144 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:53.998408 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ecee5019-b54d-41bd-8a0a-a46d6945d144 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:53.999015 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ecee5019-b54d-41bd-8a0a-a46d6945d144 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:53.999527 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ecee5019-b54d-41bd-8a0a-a46d6945d144 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:54.000314 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ecee5019-b54d-41bd-8a0a-a46d6945d144 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:54.000848 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ecee5019-b54d-41bd-8a0a-a46d6945d144 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:54.001537 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ecee5019-b54d-41bd-8a0a-a46d6945d144 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:54.145092 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ecee5019-b54d-41bd-8a0a-a46d6945d144 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:54.154596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ecee5019-b54d-41bd-8a0a-a46d6945d144 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1319 microversion: 2.1 time: 0.168181 Sep 16 08:12:54.155419 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 467/986] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:53 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1319 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:54.715467 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-82ca48c8-a3c9-4a76-9776-65bf6f8c0a63 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:54.716130 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-82ca48c8-a3c9-4a76-9776-65bf6f8c0a63 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:54.723193 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-82ca48c8-a3c9-4a76-9776-65bf6f8c0a63 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:54.724088 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-82ca48c8-a3c9-4a76-9776-65bf6f8c0a63 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:54.725676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-82ca48c8-a3c9-4a76-9776-65bf6f8c0a63 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:54.726437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-82ca48c8-a3c9-4a76-9776-65bf6f8c0a63 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:54.726933 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-82ca48c8-a3c9-4a76-9776-65bf6f8c0a63 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:54.727535 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-82ca48c8-a3c9-4a76-9776-65bf6f8c0a63 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:54.826830 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-bbc22520-f6b9-4e95-9794-72a0fa392d5c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:54.828313 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-bbc22520-f6b9-4e95-9794-72a0fa392d5c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:54.840284 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-82ca48c8-a3c9-4a76-9776-65bf6f8c0a63 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:54.841108 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bbc22520-f6b9-4e95-9794-72a0fa392d5c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:54.841972 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bbc22520-f6b9-4e95-9794-72a0fa392d5c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:54.842605 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bbc22520-f6b9-4e95-9794-72a0fa392d5c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:54.843526 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bbc22520-f6b9-4e95-9794-72a0fa392d5c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:54.844170 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bbc22520-f6b9-4e95-9794-72a0fa392d5c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:54.845106 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bbc22520-f6b9-4e95-9794-72a0fa392d5c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:54.853149 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-82ca48c8-a3c9-4a76-9776-65bf6f8c0a63 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1218 microversion: 2.1 time: 0.141665 Sep 16 08:12:54.866300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 520/987] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:54 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1218 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:55.029073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-bbc22520-f6b9-4e95-9794-72a0fa392d5c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:55.049534 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-bbc22520-f6b9-4e95-9794-72a0fa392d5c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:55.051604 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-bbc22520-f6b9-4e95-9794-72a0fa392d5c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:55.053396 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-bbc22520-f6b9-4e95-9794-72a0fa392d5c tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.232296 Sep 16 08:12:55.064407 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 468/988] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:54 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 244 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:55.177571 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-58203f5b-4d3e-4821-ac42-c3acf1cac187 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:55.178608 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-58203f5b-4d3e-4821-ac42-c3acf1cac187 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:55.185559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58203f5b-4d3e-4821-ac42-c3acf1cac187 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:55.186477 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58203f5b-4d3e-4821-ac42-c3acf1cac187 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:55.187030 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58203f5b-4d3e-4821-ac42-c3acf1cac187 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:55.187821 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58203f5b-4d3e-4821-ac42-c3acf1cac187 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:55.188377 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58203f5b-4d3e-4821-ac42-c3acf1cac187 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:55.188881 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58203f5b-4d3e-4821-ac42-c3acf1cac187 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:55.364739 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-58203f5b-4d3e-4821-ac42-c3acf1cac187 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:55.377502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-58203f5b-4d3e-4821-ac42-c3acf1cac187 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1319 microversion: 2.1 time: 0.203757 Sep 16 08:12:55.379549 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 521/989] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:55 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1319 bytes in 206 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:55.878729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-02d60a6d-6ef2-4f31-92aa-36d573a1715e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:55.880113 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-02d60a6d-6ef2-4f31-92aa-36d573a1715e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:55.886971 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-02d60a6d-6ef2-4f31-92aa-36d573a1715e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:55.887678 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-02d60a6d-6ef2-4f31-92aa-36d573a1715e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:55.888305 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-02d60a6d-6ef2-4f31-92aa-36d573a1715e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:55.889185 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-02d60a6d-6ef2-4f31-92aa-36d573a1715e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:55.889876 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-02d60a6d-6ef2-4f31-92aa-36d573a1715e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:55.890642 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-02d60a6d-6ef2-4f31-92aa-36d573a1715e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:55.955777 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-02d60a6d-6ef2-4f31-92aa-36d573a1715e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:55.964223 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-02d60a6d-6ef2-4f31-92aa-36d573a1715e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1218 microversion: 2.1 time: 0.089333 Sep 16 08:12:55.964803 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 469/990] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:55 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1218 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:56.088197 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-55c45b78-688f-4bad-9fd9-ff3c44855f04 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:56.089491 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-55c45b78-688f-4bad-9fd9-ff3c44855f04 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:56.098590 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55c45b78-688f-4bad-9fd9-ff3c44855f04 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:56.099411 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55c45b78-688f-4bad-9fd9-ff3c44855f04 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:56.100142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55c45b78-688f-4bad-9fd9-ff3c44855f04 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:56.101105 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55c45b78-688f-4bad-9fd9-ff3c44855f04 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:56.101788 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55c45b78-688f-4bad-9fd9-ff3c44855f04 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:56.102438 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55c45b78-688f-4bad-9fd9-ff3c44855f04 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:56.274989 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-55c45b78-688f-4bad-9fd9-ff3c44855f04 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:56.297760 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-55c45b78-688f-4bad-9fd9-ff3c44855f04 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:56.299283 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-55c45b78-688f-4bad-9fd9-ff3c44855f04 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:56.300743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-55c45b78-688f-4bad-9fd9-ff3c44855f04 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.217198 Sep 16 08:12:56.301485 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 522/991] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:56 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 224 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:12:56.411009 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9992371c-f4d6-44f6-8e20-89ed253fa83a tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:56.411628 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9992371c-f4d6-44f6-8e20-89ed253fa83a tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:56.417785 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9992371c-f4d6-44f6-8e20-89ed253fa83a tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:56.418275 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9992371c-f4d6-44f6-8e20-89ed253fa83a tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:56.418756 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9992371c-f4d6-44f6-8e20-89ed253fa83a tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:56.419462 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9992371c-f4d6-44f6-8e20-89ed253fa83a tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:56.419958 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9992371c-f4d6-44f6-8e20-89ed253fa83a tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:56.420389 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9992371c-f4d6-44f6-8e20-89ed253fa83a tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:56.576195 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9992371c-f4d6-44f6-8e20-89ed253fa83a tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:56.584122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9992371c-f4d6-44f6-8e20-89ed253fa83a tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1319 microversion: 2.1 time: 0.177056 Sep 16 08:12:56.604385 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 470/992] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:56 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1319 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:56.928665 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-edafa1b1-7711-47a6-936e-890315aee7c1 req-12ce961c-8f79-4892-be2e-a4c3e04a4d7c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9494f9-9706-4af0-b4ef-dac0291aae29", "name": "network-vif-plugged", "status": "completed", "tag": "cccafc8a-5a37-4427-8386-89051058ea81"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:12:56.939747 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-edafa1b1-7711-47a6-936e-890315aee7c1 req-12ce961c-8f79-4892-be2e-a4c3e04a4d7c service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:56.940236 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-edafa1b1-7711-47a6-936e-890315aee7c1 req-12ce961c-8f79-4892-be2e-a4c3e04a4d7c service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:56.940679 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-edafa1b1-7711-47a6-936e-890315aee7c1 req-12ce961c-8f79-4892-be2e-a4c3e04a4d7c service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:56.952380 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-edafa1b1-7711-47a6-936e-890315aee7c1 req-12ce961c-8f79-4892-be2e-a4c3e04a4d7c service nova] Creating event network-vif-plugged:cccafc8a-5a37-4427-8386-89051058ea81 for instance 8e9494f9-9706-4af0-b4ef-dac0291aae29 on hv-cinder-74014 Sep 16 08:12:56.957829 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-edafa1b1-7711-47a6-936e-890315aee7c1 req-12ce961c-8f79-4892-be2e-a4c3e04a4d7c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033723 Sep 16 08:12:56.959057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 523/993] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:12:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:12:56.987411 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5b2da801-9e29-4c7d-9626-1f0f14943ebe tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:56.988056 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5b2da801-9e29-4c7d-9626-1f0f14943ebe tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:56.995298 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b2da801-9e29-4c7d-9626-1f0f14943ebe tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:56.995877 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b2da801-9e29-4c7d-9626-1f0f14943ebe tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:56.996399 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b2da801-9e29-4c7d-9626-1f0f14943ebe tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:56.997361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b2da801-9e29-4c7d-9626-1f0f14943ebe tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:56.997805 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b2da801-9e29-4c7d-9626-1f0f14943ebe tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:56.998242 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b2da801-9e29-4c7d-9626-1f0f14943ebe tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:57.120164 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5b2da801-9e29-4c7d-9626-1f0f14943ebe tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:57.128140 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5b2da801-9e29-4c7d-9626-1f0f14943ebe tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1218 microversion: 2.1 time: 0.144763 Sep 16 08:12:57.128709 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 471/994] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:56 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1218 bytes in 146 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:12:57.330559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4e7cb2e1-255e-47e1-87ae-55a2a48ec0a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:57.331406 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4e7cb2e1-255e-47e1-87ae-55a2a48ec0a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:57.338739 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4e7cb2e1-255e-47e1-87ae-55a2a48ec0a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:57.339242 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4e7cb2e1-255e-47e1-87ae-55a2a48ec0a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:57.339849 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4e7cb2e1-255e-47e1-87ae-55a2a48ec0a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:57.340576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4e7cb2e1-255e-47e1-87ae-55a2a48ec0a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:57.341045 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4e7cb2e1-255e-47e1-87ae-55a2a48ec0a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:57.341654 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4e7cb2e1-255e-47e1-87ae-55a2a48ec0a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:57.504383 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4e7cb2e1-255e-47e1-87ae-55a2a48ec0a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:57.512924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4e7cb2e1-255e-47e1-87ae-55a2a48ec0a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:57.514388 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4e7cb2e1-255e-47e1-87ae-55a2a48ec0a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:57.523763 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4e7cb2e1-255e-47e1-87ae-55a2a48ec0a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.199860 Sep 16 08:12:57.524354 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 524/995] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:57 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:57.611446 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-692ad67c-d18a-4609-965a-fd0845ac61f2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:57.612162 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-692ad67c-d18a-4609-965a-fd0845ac61f2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:57.619945 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-692ad67c-d18a-4609-965a-fd0845ac61f2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:57.620747 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-692ad67c-d18a-4609-965a-fd0845ac61f2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:57.621381 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-692ad67c-d18a-4609-965a-fd0845ac61f2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:57.622301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-692ad67c-d18a-4609-965a-fd0845ac61f2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:57.622981 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-692ad67c-d18a-4609-965a-fd0845ac61f2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:57.623604 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-692ad67c-d18a-4609-965a-fd0845ac61f2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:57.805293 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-692ad67c-d18a-4609-965a-fd0845ac61f2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:57.813976 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-692ad67c-d18a-4609-965a-fd0845ac61f2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1319 microversion: 2.1 time: 0.206155 Sep 16 08:12:57.814596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 472/996] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:57 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1319 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:58.151978 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-917c484c-2f29-4a38-986f-d7ee79da4243 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:58.152829 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-917c484c-2f29-4a38-986f-d7ee79da4243 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:58.159793 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-917c484c-2f29-4a38-986f-d7ee79da4243 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:58.160296 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-917c484c-2f29-4a38-986f-d7ee79da4243 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:58.160923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-917c484c-2f29-4a38-986f-d7ee79da4243 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:58.161643 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-917c484c-2f29-4a38-986f-d7ee79da4243 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:58.162755 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-917c484c-2f29-4a38-986f-d7ee79da4243 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:58.163143 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-917c484c-2f29-4a38-986f-d7ee79da4243 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:58.235073 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-917c484c-2f29-4a38-986f-d7ee79da4243 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:58.243979 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-917c484c-2f29-4a38-986f-d7ee79da4243 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1218 microversion: 2.1 time: 0.095777 Sep 16 08:12:58.244557 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 525/997] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:58 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1218 bytes in 97 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:58.551438 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-8301a200-76fd-41c9-976a-df146f2b1fb0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:58.553324 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-8301a200-76fd-41c9-976a-df146f2b1fb0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:58.560831 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=92,nova_api:UPDATE=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:12:58.563040 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8301a200-76fd-41c9-976a-df146f2b1fb0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:58.563868 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8301a200-76fd-41c9-976a-df146f2b1fb0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:58.564564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8301a200-76fd-41c9-976a-df146f2b1fb0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:58.565540 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8301a200-76fd-41c9-976a-df146f2b1fb0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:58.566361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8301a200-76fd-41c9-976a-df146f2b1fb0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:58.567377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8301a200-76fd-41c9-976a-df146f2b1fb0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:58.712322 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-8301a200-76fd-41c9-976a-df146f2b1fb0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:58.721230 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-8301a200-76fd-41c9-976a-df146f2b1fb0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:58.723002 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-8301a200-76fd-41c9-976a-df146f2b1fb0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:58.741572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-8301a200-76fd-41c9-976a-df146f2b1fb0 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.176949 Sep 16 08:12:58.741572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 473/998] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:58 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:12:58.837770 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3600b732-e690-45df-b6c8-38327ae67540 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:58.839594 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3600b732-e690-45df-b6c8-38327ae67540 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:58.848677 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3600b732-e690-45df-b6c8-38327ae67540 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:58.850350 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3600b732-e690-45df-b6c8-38327ae67540 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:58.851080 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3600b732-e690-45df-b6c8-38327ae67540 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:58.852063 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3600b732-e690-45df-b6c8-38327ae67540 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:58.852816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3600b732-e690-45df-b6c8-38327ae67540 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:58.853278 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3600b732-e690-45df-b6c8-38327ae67540 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:59.002315 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3600b732-e690-45df-b6c8-38327ae67540 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:59.014705 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3600b732-e690-45df-b6c8-38327ae67540 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1319 microversion: 2.1 time: 0.181667 Sep 16 08:12:59.031631 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 526/999] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:58 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1319 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:59.268549 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-03f61f99-31c7-4848-9496-40f4d3811892 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:59.269243 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-03f61f99-31c7-4848-9496-40f4d3811892 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:59.276362 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-03f61f99-31c7-4848-9496-40f4d3811892 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:59.278664 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-03f61f99-31c7-4848-9496-40f4d3811892 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:59.278664 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-03f61f99-31c7-4848-9496-40f4d3811892 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:59.279130 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-03f61f99-31c7-4848-9496-40f4d3811892 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:59.279822 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-03f61f99-31c7-4848-9496-40f4d3811892 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:59.280506 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-03f61f99-31c7-4848-9496-40f4d3811892 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:59.356809 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-03f61f99-31c7-4848-9496-40f4d3811892 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:59.365157 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-03f61f99-31c7-4848-9496-40f4d3811892 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1218 microversion: 2.1 time: 0.101125 Sep 16 08:12:59.371029 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 474/1000] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:12:59 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1218 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:12:59.751408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-963632b5-058f-4e48-8de7-60ec041b8774 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:12:59.752021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-963632b5-058f-4e48-8de7-60ec041b8774 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:12:59.758024 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-963632b5-058f-4e48-8de7-60ec041b8774 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:59.764649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-963632b5-058f-4e48-8de7-60ec041b8774 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:59.764649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-963632b5-058f-4e48-8de7-60ec041b8774 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:59.764649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-963632b5-058f-4e48-8de7-60ec041b8774 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:12:59.764649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-963632b5-058f-4e48-8de7-60ec041b8774 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:12:59.765227 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-963632b5-058f-4e48-8de7-60ec041b8774 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:12:59.933115 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-963632b5-058f-4e48-8de7-60ec041b8774 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:59.941247 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-963632b5-058f-4e48-8de7-60ec041b8774 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:59.942699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-963632b5-058f-4e48-8de7-60ec041b8774 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:12:59.943858 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-963632b5-058f-4e48-8de7-60ec041b8774 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.196496 Sep 16 08:12:59.944411 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 527/1001] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:12:59 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:13:00.039875 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4d41402a-1419-4145-b296-14538c631097 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:00.040441 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4d41402a-1419-4145-b296-14538c631097 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:00.046918 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d41402a-1419-4145-b296-14538c631097 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:00.047401 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d41402a-1419-4145-b296-14538c631097 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:00.047839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d41402a-1419-4145-b296-14538c631097 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:00.048524 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d41402a-1419-4145-b296-14538c631097 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:00.049016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d41402a-1419-4145-b296-14538c631097 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:00.049440 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d41402a-1419-4145-b296-14538c631097 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:00.065370 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=100 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:00.201466 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-4d41402a-1419-4145-b296-14538c631097 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:00.211684 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4d41402a-1419-4145-b296-14538c631097 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1319 microversion: 2.1 time: 0.175831 Sep 16 08:13:00.215259 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 475/1002] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:00 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1319 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:00.389400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-91e0cafa-f66d-4517-8042-6dcd6135d28f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:00.390010 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-91e0cafa-f66d-4517-8042-6dcd6135d28f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:00.395992 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91e0cafa-f66d-4517-8042-6dcd6135d28f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:00.397142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91e0cafa-f66d-4517-8042-6dcd6135d28f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:00.397491 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91e0cafa-f66d-4517-8042-6dcd6135d28f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:00.398186 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91e0cafa-f66d-4517-8042-6dcd6135d28f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:00.398645 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91e0cafa-f66d-4517-8042-6dcd6135d28f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:00.399103 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-91e0cafa-f66d-4517-8042-6dcd6135d28f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:00.463932 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-91e0cafa-f66d-4517-8042-6dcd6135d28f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:00.471832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-91e0cafa-f66d-4517-8042-6dcd6135d28f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1218 microversion: 2.1 time: 0.086539 Sep 16 08:13:00.472404 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 528/1003] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:00 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1218 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:00.968728 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-34bde860-b3ca-41c9-a4e3-00af0adbdb30 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:00.969519 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-34bde860-b3ca-41c9-a4e3-00af0adbdb30 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:00.975484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-34bde860-b3ca-41c9-a4e3-00af0adbdb30 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:00.976002 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-34bde860-b3ca-41c9-a4e3-00af0adbdb30 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:00.976450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-34bde860-b3ca-41c9-a4e3-00af0adbdb30 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:00.977153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-34bde860-b3ca-41c9-a4e3-00af0adbdb30 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:00.977614 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-34bde860-b3ca-41c9-a4e3-00af0adbdb30 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:00.978037 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-34bde860-b3ca-41c9-a4e3-00af0adbdb30 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:01.122589 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-34bde860-b3ca-41c9-a4e3-00af0adbdb30 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:01.137022 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-34bde860-b3ca-41c9-a4e3-00af0adbdb30 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:01.137022 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-34bde860-b3ca-41c9-a4e3-00af0adbdb30 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:01.137022 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-34bde860-b3ca-41c9-a4e3-00af0adbdb30 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.171120 Sep 16 08:13:01.137389 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 476/1004] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:13:00 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 172 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:13:01.237824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-24ec5606-b887-4f01-b2a5-756b89760903 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:01.239109 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-24ec5606-b887-4f01-b2a5-756b89760903 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:01.251185 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-24ec5606-b887-4f01-b2a5-756b89760903 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:01.251185 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-24ec5606-b887-4f01-b2a5-756b89760903 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:01.251185 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-24ec5606-b887-4f01-b2a5-756b89760903 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:01.251777 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-24ec5606-b887-4f01-b2a5-756b89760903 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:01.252533 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-24ec5606-b887-4f01-b2a5-756b89760903 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:01.253627 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-24ec5606-b887-4f01-b2a5-756b89760903 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:01.465504 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-24ec5606-b887-4f01-b2a5-756b89760903 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:01.468922 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:INSERT=1,nova_cell1:SELECT=99 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:01.475352 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-24ec5606-b887-4f01-b2a5-756b89760903 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1319 microversion: 2.1 time: 0.242873 Sep 16 08:13:01.476439 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 529/1005] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:01 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1319 bytes in 245 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:01.495580 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5aa5204e-ad2c-4f3a-bf38-554ecc2a8ef2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:01.496289 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5aa5204e-ad2c-4f3a-bf38-554ecc2a8ef2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:01.502344 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5aa5204e-ad2c-4f3a-bf38-554ecc2a8ef2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:01.503097 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5aa5204e-ad2c-4f3a-bf38-554ecc2a8ef2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:01.503535 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5aa5204e-ad2c-4f3a-bf38-554ecc2a8ef2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:01.504228 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5aa5204e-ad2c-4f3a-bf38-554ecc2a8ef2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:01.504886 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5aa5204e-ad2c-4f3a-bf38-554ecc2a8ef2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:01.505124 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5aa5204e-ad2c-4f3a-bf38-554ecc2a8ef2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:01.567729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5aa5204e-ad2c-4f3a-bf38-554ecc2a8ef2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:01.577569 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5aa5204e-ad2c-4f3a-bf38-554ecc2a8ef2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1266 microversion: 2.1 time: 0.086600 Sep 16 08:13:01.582332 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 477/1006] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:01 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1266 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:02.161575 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a4e84584-86e5-4571-b06a-963c182facfc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:02.162537 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a4e84584-86e5-4571-b06a-963c182facfc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:02.169442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a4e84584-86e5-4571-b06a-963c182facfc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:02.170161 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a4e84584-86e5-4571-b06a-963c182facfc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:02.170603 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a4e84584-86e5-4571-b06a-963c182facfc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:02.171515 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a4e84584-86e5-4571-b06a-963c182facfc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:02.172279 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a4e84584-86e5-4571-b06a-963c182facfc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:02.172796 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a4e84584-86e5-4571-b06a-963c182facfc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:02.191560 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=4 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:02.501511 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b8b70132-ac1a-4b99-acb1-6ac729245d1b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:02.502272 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b8b70132-ac1a-4b99-acb1-6ac729245d1b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:02.511922 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8b70132-ac1a-4b99-acb1-6ac729245d1b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:02.512562 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8b70132-ac1a-4b99-acb1-6ac729245d1b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:02.513103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8b70132-ac1a-4b99-acb1-6ac729245d1b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:02.514081 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8b70132-ac1a-4b99-acb1-6ac729245d1b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:02.514866 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8b70132-ac1a-4b99-acb1-6ac729245d1b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:02.515387 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b8b70132-ac1a-4b99-acb1-6ac729245d1b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:02.522551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=16 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:02.551058 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a4e84584-86e5-4571-b06a-963c182facfc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:02.559886 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a4e84584-86e5-4571-b06a-963c182facfc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:02.561378 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a4e84584-86e5-4571-b06a-963c182facfc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:02.562564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a4e84584-86e5-4571-b06a-963c182facfc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.405179 Sep 16 08:13:02.563151 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 530/1007] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:13:02 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 406 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:13:02.602784 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-56988491-1a97-4305-8a34-c5e045f7e9bb tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:02.605042 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-56988491-1a97-4305-8a34-c5e045f7e9bb tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:02.610524 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56988491-1a97-4305-8a34-c5e045f7e9bb tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:02.611804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56988491-1a97-4305-8a34-c5e045f7e9bb tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:02.612964 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56988491-1a97-4305-8a34-c5e045f7e9bb tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:02.614427 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56988491-1a97-4305-8a34-c5e045f7e9bb tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:02.615116 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56988491-1a97-4305-8a34-c5e045f7e9bb tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:02.615727 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56988491-1a97-4305-8a34-c5e045f7e9bb tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:02.668298 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b8b70132-ac1a-4b99-acb1-6ac729245d1b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:02.678365 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b8b70132-ac1a-4b99-acb1-6ac729245d1b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1319 microversion: 2.1 time: 0.182990 Sep 16 08:13:02.686172 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-56988491-1a97-4305-8a34-c5e045f7e9bb tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:02.695183 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-56988491-1a97-4305-8a34-c5e045f7e9bb tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1266 microversion: 2.1 time: 0.097573 Sep 16 08:13:02.695365 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 478/1008] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:02 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1319 bytes in 201 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:02.696065 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 531/1009] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:02 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1266 bytes in 99 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:03.589164 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9c4b76dc-176b-4e6f-a04b-084704b24f51 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:03.590098 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9c4b76dc-176b-4e6f-a04b-084704b24f51 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:03.597960 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c4b76dc-176b-4e6f-a04b-084704b24f51 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:03.598753 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c4b76dc-176b-4e6f-a04b-084704b24f51 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:03.599436 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c4b76dc-176b-4e6f-a04b-084704b24f51 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:03.600505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c4b76dc-176b-4e6f-a04b-084704b24f51 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:03.601555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c4b76dc-176b-4e6f-a04b-084704b24f51 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:03.601999 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9c4b76dc-176b-4e6f-a04b-084704b24f51 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:03.703770 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dd35dae3-216d-41a1-8d32-89eb615a7525 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:03.704319 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dd35dae3-216d-41a1-8d32-89eb615a7525 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:03.713971 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd35dae3-216d-41a1-8d32-89eb615a7525 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:03.714478 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd35dae3-216d-41a1-8d32-89eb615a7525 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:03.727461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd35dae3-216d-41a1-8d32-89eb615a7525 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:03.728238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd35dae3-216d-41a1-8d32-89eb615a7525 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:03.728728 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd35dae3-216d-41a1-8d32-89eb615a7525 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:03.729170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dd35dae3-216d-41a1-8d32-89eb615a7525 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:03.989845 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dd35dae3-216d-41a1-8d32-89eb615a7525 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:04.002156 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dd35dae3-216d-41a1-8d32-89eb615a7525 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1507 microversion: 2.1 time: 0.302283 Sep 16 08:13:04.205491 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 532/1010] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:03 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1507 bytes in 304 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:04.205491 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-fb08c905-e61f-4d5d-a905-03a413eef6ab tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:04.205491 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-fb08c905-e61f-4d5d-a905-03a413eef6ab tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:04.205491 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fb08c905-e61f-4d5d-a905-03a413eef6ab tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:04.205491 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fb08c905-e61f-4d5d-a905-03a413eef6ab tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:04.206817 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fb08c905-e61f-4d5d-a905-03a413eef6ab tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:04.206817 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fb08c905-e61f-4d5d-a905-03a413eef6ab tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:04.206817 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fb08c905-e61f-4d5d-a905-03a413eef6ab tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:04.206817 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fb08c905-e61f-4d5d-a905-03a413eef6ab tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:04.207366 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9c4b76dc-176b-4e6f-a04b-084704b24f51 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:04.207366 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9c4b76dc-176b-4e6f-a04b-084704b24f51 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:04.207631 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9c4b76dc-176b-4e6f-a04b-084704b24f51 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:04.207631 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9c4b76dc-176b-4e6f-a04b-084704b24f51 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.496088 Sep 16 08:13:04.207631 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 479/1011] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:13:03 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 497 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:13:04.207941 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-fb08c905-e61f-4d5d-a905-03a413eef6ab tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:04.207941 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-fb08c905-e61f-4d5d-a905-03a413eef6ab tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1272 microversion: 2.1 time: 0.096493 Sep 16 08:13:04.207941 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 533/1012] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:04 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1272 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:04.916588 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-f5ecf9b2-ee5c-4960-bceb-7c32d32b5439 req-b7769fb5-f0fa-4b3f-8e4f-047c046ba7b5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6b33b5-7327-4c2f-ae74-6f718e860360", "name": "network-vif-plugged", "status": "completed", "tag": "24fc5230-45b4-476e-ae08-dc736c4339d1"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:13:04.940953 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-f5ecf9b2-ee5c-4960-bceb-7c32d32b5439 req-b7769fb5-f0fa-4b3f-8e4f-047c046ba7b5 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:04.941530 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-f5ecf9b2-ee5c-4960-bceb-7c32d32b5439 req-b7769fb5-f0fa-4b3f-8e4f-047c046ba7b5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:04.943705 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-f5ecf9b2-ee5c-4960-bceb-7c32d32b5439 req-b7769fb5-f0fa-4b3f-8e4f-047c046ba7b5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:04.956807 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-f5ecf9b2-ee5c-4960-bceb-7c32d32b5439 req-b7769fb5-f0fa-4b3f-8e4f-047c046ba7b5 service nova] Creating event network-vif-plugged:24fc5230-45b4-476e-ae08-dc736c4339d1 for instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 on hv-cinder-74014 Sep 16 08:13:04.962173 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-f5ecf9b2-ee5c-4960-bceb-7c32d32b5439 req-b7769fb5-f0fa-4b3f-8e4f-047c046ba7b5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055049 Sep 16 08:13:04.963092 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 480/1013] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:13:04 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 57 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:13:05.230104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-02f5bf24-56a1-4907-8023-129994f1d954 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:05.230744 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-02f5bf24-56a1-4907-8023-129994f1d954 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:05.234222 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-965dada0-bc4c-4350-83eb-8450d2a781ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:05.235051 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-965dada0-bc4c-4350-83eb-8450d2a781ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:05.237837 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-02f5bf24-56a1-4907-8023-129994f1d954 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:05.238772 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-02f5bf24-56a1-4907-8023-129994f1d954 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:05.239223 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-02f5bf24-56a1-4907-8023-129994f1d954 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:05.240205 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-02f5bf24-56a1-4907-8023-129994f1d954 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:05.240676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-02f5bf24-56a1-4907-8023-129994f1d954 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:05.241169 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-02f5bf24-56a1-4907-8023-129994f1d954 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:05.241972 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-965dada0-bc4c-4350-83eb-8450d2a781ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:05.242492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-965dada0-bc4c-4350-83eb-8450d2a781ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:05.242963 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-965dada0-bc4c-4350-83eb-8450d2a781ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:05.250456 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-965dada0-bc4c-4350-83eb-8450d2a781ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:05.250456 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-965dada0-bc4c-4350-83eb-8450d2a781ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:05.250456 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-965dada0-bc4c-4350-83eb-8450d2a781ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:05.457585 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-965dada0-bc4c-4350-83eb-8450d2a781ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:05.467044 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-965dada0-bc4c-4350-83eb-8450d2a781ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:05.468562 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-965dada0-bc4c-4350-83eb-8450d2a781ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:05.469749 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-965dada0-bc4c-4350-83eb-8450d2a781ad tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.239892 Sep 16 08:13:05.470293 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 481/1014] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:13:05 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 241 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:13:05.478203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-02f5bf24-56a1-4907-8023-129994f1d954 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:05.486313 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-02f5bf24-56a1-4907-8023-129994f1d954 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1314 microversion: 2.1 time: 0.260803 Sep 16 08:13:05.488901 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 534/1015] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:05 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1314 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:05.833061 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-117d912c-61af-4a64-9aaa-02569b10c28c req-1cbd851c-9c51-4bb7-9891-af9865648f9d service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "07a2df18-56fc-4d48-9eed-009403b79b7e", "tag": "fa90d04f-de45-4124-aa59-7ac7f7183407"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:13:05.842993 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-117d912c-61af-4a64-9aaa-02569b10c28c req-1cbd851c-9c51-4bb7-9891-af9865648f9d service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:05.843472 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-117d912c-61af-4a64-9aaa-02569b10c28c req-1cbd851c-9c51-4bb7-9891-af9865648f9d service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:05.843898 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-117d912c-61af-4a64-9aaa-02569b10c28c req-1cbd851c-9c51-4bb7-9891-af9865648f9d service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:05.855875 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-117d912c-61af-4a64-9aaa-02569b10c28c req-1cbd851c-9c51-4bb7-9891-af9865648f9d service nova] Creating event network-changed:fa90d04f-de45-4124-aa59-7ac7f7183407 for instance 07a2df18-56fc-4d48-9eed-009403b79b7e on hv-cinder-74014 Sep 16 08:13:05.861116 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-117d912c-61af-4a64-9aaa-02569b10c28c req-1cbd851c-9c51-4bb7-9891-af9865648f9d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032074 Sep 16 08:13:05.861409 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 482/1016] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:13:05 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:13:06.497862 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a696f6b3-6c7c-4361-acf4-46856ee387fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:06.498776 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a696f6b3-6c7c-4361-acf4-46856ee387fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:06.506211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a696f6b3-6c7c-4361-acf4-46856ee387fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:06.512555 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f4feb14e-aed7-4c0a-bbdb-9975f4b055ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:06.513896 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f4feb14e-aed7-4c0a-bbdb-9975f4b055ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:06.517641 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a696f6b3-6c7c-4361-acf4-46856ee387fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:06.518108 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a696f6b3-6c7c-4361-acf4-46856ee387fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.011s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:06.518924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a696f6b3-6c7c-4361-acf4-46856ee387fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:06.519393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a696f6b3-6c7c-4361-acf4-46856ee387fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:06.520006 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a696f6b3-6c7c-4361-acf4-46856ee387fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:06.520931 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f4feb14e-aed7-4c0a-bbdb-9975f4b055ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:06.521491 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f4feb14e-aed7-4c0a-bbdb-9975f4b055ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:06.522032 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f4feb14e-aed7-4c0a-bbdb-9975f4b055ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:06.523079 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f4feb14e-aed7-4c0a-bbdb-9975f4b055ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:06.524096 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f4feb14e-aed7-4c0a-bbdb-9975f4b055ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:06.524540 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f4feb14e-aed7-4c0a-bbdb-9975f4b055ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:06.678984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f4feb14e-aed7-4c0a-bbdb-9975f4b055ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:06.685547 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a696f6b3-6c7c-4361-acf4-46856ee387fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:06.687749 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f4feb14e-aed7-4c0a-bbdb-9975f4b055ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1314 microversion: 2.1 time: 0.179767 Sep 16 08:13:06.696472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a696f6b3-6c7c-4361-acf4-46856ee387fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:06.697938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a696f6b3-6c7c-4361-acf4-46856ee387fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:06.699177 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a696f6b3-6c7c-4361-acf4-46856ee387fc tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.207175 Sep 16 08:13:06.699781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 535/1017] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:13:06 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:13:06.700491 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 483/1018] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:06 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1314 bytes in 193 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:07.720663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c71ecf15-5ee9-4a2f-a9fe-448042151c8e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:07.720663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c71ecf15-5ee9-4a2f-a9fe-448042151c8e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:07.725855 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c71ecf15-5ee9-4a2f-a9fe-448042151c8e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:07.726911 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c71ecf15-5ee9-4a2f-a9fe-448042151c8e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:07.727517 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c71ecf15-5ee9-4a2f-a9fe-448042151c8e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:07.728091 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7ddcdad0-8465-4a58-a238-f962dad6e10e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:07.728518 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c71ecf15-5ee9-4a2f-a9fe-448042151c8e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:07.728791 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c71ecf15-5ee9-4a2f-a9fe-448042151c8e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:07.728891 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7ddcdad0-8465-4a58-a238-f962dad6e10e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:07.729490 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c71ecf15-5ee9-4a2f-a9fe-448042151c8e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:07.735247 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ddcdad0-8465-4a58-a238-f962dad6e10e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:07.735953 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ddcdad0-8465-4a58-a238-f962dad6e10e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:07.736565 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ddcdad0-8465-4a58-a238-f962dad6e10e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:07.737700 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ddcdad0-8465-4a58-a238-f962dad6e10e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:07.738327 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ddcdad0-8465-4a58-a238-f962dad6e10e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:07.738951 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ddcdad0-8465-4a58-a238-f962dad6e10e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:07.891097 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c71ecf15-5ee9-4a2f-a9fe-448042151c8e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:07.900375 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c71ecf15-5ee9-4a2f-a9fe-448042151c8e tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1314 microversion: 2.1 time: 0.186579 Sep 16 08:13:07.901716 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7ddcdad0-8465-4a58-a238-f962dad6e10e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:07.904371 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 536/1019] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:07 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1314 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:07.910773 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7ddcdad0-8465-4a58-a238-f962dad6e10e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:07.915291 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7ddcdad0-8465-4a58-a238-f962dad6e10e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:07.916512 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7ddcdad0-8465-4a58-a238-f962dad6e10e tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1731 microversion: 2.20 time: 0.194123 Sep 16 08:13:07.922776 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 484/1020] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:13:07 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1731 bytes in 195 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:13:08.926269 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-725ecea8-44fd-4a94-a5f0-aecea242b56f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:08.927164 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-725ecea8-44fd-4a94-a5f0-aecea242b56f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:08.934393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-725ecea8-44fd-4a94-a5f0-aecea242b56f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:08.936440 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-725ecea8-44fd-4a94-a5f0-aecea242b56f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:08.936932 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-725ecea8-44fd-4a94-a5f0-aecea242b56f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:08.937670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-725ecea8-44fd-4a94-a5f0-aecea242b56f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:08.938169 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-725ecea8-44fd-4a94-a5f0-aecea242b56f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:08.938641 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-725ecea8-44fd-4a94-a5f0-aecea242b56f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:08.941948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-718f5ef1-cb4d-4c03-965e-dd6204fe4dce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:08.942748 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-718f5ef1-cb4d-4c03-965e-dd6204fe4dce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:08.950165 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-718f5ef1-cb4d-4c03-965e-dd6204fe4dce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:08.950880 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-718f5ef1-cb4d-4c03-965e-dd6204fe4dce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:08.951525 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-718f5ef1-cb4d-4c03-965e-dd6204fe4dce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:08.956135 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-718f5ef1-cb4d-4c03-965e-dd6204fe4dce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:08.956135 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-718f5ef1-cb4d-4c03-965e-dd6204fe4dce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:08.956135 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-718f5ef1-cb4d-4c03-965e-dd6204fe4dce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:09.104924 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-718f5ef1-cb4d-4c03-965e-dd6204fe4dce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:09.113216 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-718f5ef1-cb4d-4c03-965e-dd6204fe4dce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:09.114659 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-718f5ef1-cb4d-4c03-965e-dd6204fe4dce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:09.115850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-718f5ef1-cb4d-4c03-965e-dd6204fe4dce tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1718 microversion: 2.20 time: 0.178237 Sep 16 08:13:09.116420 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 485/1021] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:13:08 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1718 bytes in 180 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:13:09.122478 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-725ecea8-44fd-4a94-a5f0-aecea242b56f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:09.130172 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-725ecea8-44fd-4a94-a5f0-aecea242b56f tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1314 microversion: 2.1 time: 0.207952 Sep 16 08:13:09.130758 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 537/1022] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:08 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1314 bytes in 209 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:10.152660 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-43789159-14f7-4bf3-ba89-8e2a68d24afc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:10.153538 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-43789159-14f7-4bf3-ba89-8e2a68d24afc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:10.160029 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-43789159-14f7-4bf3-ba89-8e2a68d24afc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:10.160516 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-43789159-14f7-4bf3-ba89-8e2a68d24afc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:10.164330 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-43789159-14f7-4bf3-ba89-8e2a68d24afc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:10.164330 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-43789159-14f7-4bf3-ba89-8e2a68d24afc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:10.164330 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-43789159-14f7-4bf3-ba89-8e2a68d24afc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:10.164330 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-43789159-14f7-4bf3-ba89-8e2a68d24afc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:10.377611 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-43789159-14f7-4bf3-ba89-8e2a68d24afc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:10.385611 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-43789159-14f7-4bf3-ba89-8e2a68d24afc tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1314 microversion: 2.1 time: 0.236825 Sep 16 08:13:10.386187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 486/1023] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:10 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1314 bytes in 238 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:11.408808 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6930f424-d2c9-427b-9e22-bc84ef8982e2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:11.409428 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6930f424-d2c9-427b-9e22-bc84ef8982e2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:11.416531 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6930f424-d2c9-427b-9e22-bc84ef8982e2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:11.419472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6930f424-d2c9-427b-9e22-bc84ef8982e2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:11.419472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6930f424-d2c9-427b-9e22-bc84ef8982e2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:11.419472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6930f424-d2c9-427b-9e22-bc84ef8982e2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:11.419472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6930f424-d2c9-427b-9e22-bc84ef8982e2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:11.419834 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6930f424-d2c9-427b-9e22-bc84ef8982e2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:11.571695 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6930f424-d2c9-427b-9e22-bc84ef8982e2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:11.579801 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6930f424-d2c9-427b-9e22-bc84ef8982e2 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1314 microversion: 2.1 time: 0.174866 Sep 16 08:13:11.580539 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 538/1024] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:11 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1314 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:12.602652 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-bb49e988-76c9-4443-aa44-ac6e84a537c3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:12.603279 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-bb49e988-76c9-4443-aa44-ac6e84a537c3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:12.609501 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb49e988-76c9-4443-aa44-ac6e84a537c3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:12.609989 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb49e988-76c9-4443-aa44-ac6e84a537c3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:12.610424 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb49e988-76c9-4443-aa44-ac6e84a537c3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:12.611142 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb49e988-76c9-4443-aa44-ac6e84a537c3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:12.611594 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb49e988-76c9-4443-aa44-ac6e84a537c3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:12.612017 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bb49e988-76c9-4443-aa44-ac6e84a537c3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:12.738829 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-bb49e988-76c9-4443-aa44-ac6e84a537c3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:12.747043 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-bb49e988-76c9-4443-aa44-ac6e84a537c3 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1314 microversion: 2.1 time: 0.148495 Sep 16 08:13:12.747603 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 487/1025] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:12 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1314 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:13.024881 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-e16076c1-ad0e-4bb3-b676-b4873a45e0e2 req-f1dd71cc-e569-476f-8e5d-255ddb18ee7d service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a2df18-56fc-4d48-9eed-009403b79b7e", "name": "network-vif-plugged", "status": "completed", "tag": "fa90d04f-de45-4124-aa59-7ac7f7183407"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:13:13.035476 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-e16076c1-ad0e-4bb3-b676-b4873a45e0e2 req-f1dd71cc-e569-476f-8e5d-255ddb18ee7d service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:13.036223 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-e16076c1-ad0e-4bb3-b676-b4873a45e0e2 req-f1dd71cc-e569-476f-8e5d-255ddb18ee7d service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:13.036544 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-e16076c1-ad0e-4bb3-b676-b4873a45e0e2 req-f1dd71cc-e569-476f-8e5d-255ddb18ee7d service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:13.049426 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-e16076c1-ad0e-4bb3-b676-b4873a45e0e2 req-f1dd71cc-e569-476f-8e5d-255ddb18ee7d service nova] Creating event network-vif-plugged:fa90d04f-de45-4124-aa59-7ac7f7183407 for instance 07a2df18-56fc-4d48-9eed-009403b79b7e on hv-cinder-74014 Sep 16 08:13:13.055143 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-e16076c1-ad0e-4bb3-b676-b4873a45e0e2 req-f1dd71cc-e569-476f-8e5d-255ddb18ee7d service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033420 Sep 16 08:13:13.055764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 539/1026] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:13:13 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:13:13.770959 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a9c7ad4e-0b63-4c78-ac2d-846012c820a4 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:13.771832 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a9c7ad4e-0b63-4c78-ac2d-846012c820a4 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:13.779634 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a9c7ad4e-0b63-4c78-ac2d-846012c820a4 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:13.780193 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a9c7ad4e-0b63-4c78-ac2d-846012c820a4 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:13.780706 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a9c7ad4e-0b63-4c78-ac2d-846012c820a4 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:13.781444 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a9c7ad4e-0b63-4c78-ac2d-846012c820a4 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:13.782082 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a9c7ad4e-0b63-4c78-ac2d-846012c820a4 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:13.782537 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a9c7ad4e-0b63-4c78-ac2d-846012c820a4 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:13.923042 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a9c7ad4e-0b63-4c78-ac2d-846012c820a4 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:13.931098 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a9c7ad4e-0b63-4c78-ac2d-846012c820a4 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1314 microversion: 2.1 time: 0.165349 Sep 16 08:13:13.931678 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 488/1027] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:13 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1314 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:14.956610 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f16dd638-c129-4680-acd9-ae023744d72c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:14.957309 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f16dd638-c129-4680-acd9-ae023744d72c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:14.963363 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f16dd638-c129-4680-acd9-ae023744d72c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:14.963846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f16dd638-c129-4680-acd9-ae023744d72c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:14.964282 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f16dd638-c129-4680-acd9-ae023744d72c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:14.964984 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f16dd638-c129-4680-acd9-ae023744d72c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:14.965423 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f16dd638-c129-4680-acd9-ae023744d72c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:14.965849 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f16dd638-c129-4680-acd9-ae023744d72c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:15.095212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f16dd638-c129-4680-acd9-ae023744d72c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:15.103386 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f16dd638-c129-4680-acd9-ae023744d72c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1314 microversion: 2.1 time: 0.151627 Sep 16 08:13:15.103943 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 540/1028] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:14 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1314 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:16.125170 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9aaf65a2-6d8c-4081-9429-9212c19bdde9 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:16.125750 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9aaf65a2-6d8c-4081-9429-9212c19bdde9 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:16.132388 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9aaf65a2-6d8c-4081-9429-9212c19bdde9 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:16.133433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9aaf65a2-6d8c-4081-9429-9212c19bdde9 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:16.133877 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9aaf65a2-6d8c-4081-9429-9212c19bdde9 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:16.134572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9aaf65a2-6d8c-4081-9429-9212c19bdde9 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:16.135063 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9aaf65a2-6d8c-4081-9429-9212c19bdde9 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:16.135496 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9aaf65a2-6d8c-4081-9429-9212c19bdde9 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:16.266218 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9aaf65a2-6d8c-4081-9429-9212c19bdde9 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:16.273899 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9aaf65a2-6d8c-4081-9429-9212c19bdde9 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1314 microversion: 2.1 time: 0.152637 Sep 16 08:13:16.274456 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 489/1029] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:16 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1314 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:17.296335 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-575bbec8-61d5-4d0f-852d-3b4b40b1c57d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:17.297041 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-575bbec8-61d5-4d0f-852d-3b4b40b1c57d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:17.303779 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-575bbec8-61d5-4d0f-852d-3b4b40b1c57d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:17.304284 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-575bbec8-61d5-4d0f-852d-3b4b40b1c57d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:17.305226 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-575bbec8-61d5-4d0f-852d-3b4b40b1c57d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:17.305935 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-575bbec8-61d5-4d0f-852d-3b4b40b1c57d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:17.306395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-575bbec8-61d5-4d0f-852d-3b4b40b1c57d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:17.306938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-575bbec8-61d5-4d0f-852d-3b4b40b1c57d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:17.435859 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-575bbec8-61d5-4d0f-852d-3b4b40b1c57d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:17.443706 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-575bbec8-61d5-4d0f-852d-3b4b40b1c57d tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1314 microversion: 2.1 time: 0.151067 Sep 16 08:13:17.444277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 541/1030] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:17 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1314 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:18.466381 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c972c6b7-0fe8-4f74-8fcb-0cb55c1d1549 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:18.467015 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c972c6b7-0fe8-4f74-8fcb-0cb55c1d1549 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:18.473464 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c972c6b7-0fe8-4f74-8fcb-0cb55c1d1549 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:18.473928 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c972c6b7-0fe8-4f74-8fcb-0cb55c1d1549 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:18.474360 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c972c6b7-0fe8-4f74-8fcb-0cb55c1d1549 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:18.475073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c972c6b7-0fe8-4f74-8fcb-0cb55c1d1549 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:18.475523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c972c6b7-0fe8-4f74-8fcb-0cb55c1d1549 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:18.475943 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c972c6b7-0fe8-4f74-8fcb-0cb55c1d1549 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:18.603922 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c972c6b7-0fe8-4f74-8fcb-0cb55c1d1549 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:18.611792 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c972c6b7-0fe8-4f74-8fcb-0cb55c1d1549 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1498 microversion: 2.1 time: 0.149413 Sep 16 08:13:18.612470 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 490/1031] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:18 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1498 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:22.842181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-86f744fc-1ddb-4939-ae20-daf7bfc8050c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:22.842700 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-86f744fc-1ddb-4939-ae20-daf7bfc8050c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:22.845166 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=84,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:22.849985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-86f744fc-1ddb-4939-ae20-daf7bfc8050c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:22.850474 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-86f744fc-1ddb-4939-ae20-daf7bfc8050c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:22.851043 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-86f744fc-1ddb-4939-ae20-daf7bfc8050c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:22.855480 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-86f744fc-1ddb-4939-ae20-daf7bfc8050c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:22.855480 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-86f744fc-1ddb-4939-ae20-daf7bfc8050c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:22.855480 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-86f744fc-1ddb-4939-ae20-daf7bfc8050c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:22.878769 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-86f744fc-1ddb-4939-ae20-daf7bfc8050c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:13:23.232759 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-86f744fc-1ddb-4939-ae20-daf7bfc8050c tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "DELETE /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 204 len: 0 microversion: 2.1 time: 0.394182 Sep 16 08:13:23.233412 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 542/1032] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:13:22 2022] DELETE /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 0 bytes in 396 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:13:23.241740 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-db3ae314-2424-424c-a61f-49209f9c905b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:23.243067 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-db3ae314-2424-424c-a61f-49209f9c905b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:23.249916 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-db3ae314-2424-424c-a61f-49209f9c905b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:23.250314 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-db3ae314-2424-424c-a61f-49209f9c905b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:23.250785 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-db3ae314-2424-424c-a61f-49209f9c905b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:23.251480 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-db3ae314-2424-424c-a61f-49209f9c905b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:23.251938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-db3ae314-2424-424c-a61f-49209f9c905b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:23.252384 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-db3ae314-2424-424c-a61f-49209f9c905b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:23.392464 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-db3ae314-2424-424c-a61f-49209f9c905b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:23.400904 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-db3ae314-2424-424c-a61f-49209f9c905b tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1504 microversion: 2.1 time: 0.163086 Sep 16 08:13:23.401476 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 491/1033] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:23 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1504 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:24.426840 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d9571c26-b8ef-490c-bcff-25720fdfc8fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:24.427534 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d9571c26-b8ef-490c-bcff-25720fdfc8fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:24.434601 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d9571c26-b8ef-490c-bcff-25720fdfc8fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:24.435123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d9571c26-b8ef-490c-bcff-25720fdfc8fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:24.435559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d9571c26-b8ef-490c-bcff-25720fdfc8fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:24.437923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d9571c26-b8ef-490c-bcff-25720fdfc8fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:24.437923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d9571c26-b8ef-490c-bcff-25720fdfc8fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:24.437923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d9571c26-b8ef-490c-bcff-25720fdfc8fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:24.565742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d9571c26-b8ef-490c-bcff-25720fdfc8fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:24.574184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d9571c26-b8ef-490c-bcff-25720fdfc8fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1504 microversion: 2.1 time: 0.151595 Sep 16 08:13:24.574784 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 543/1034] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:24 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1504 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:25.080390 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3b5d036c-bc54-46cb-b132-54e1f945283b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "8c52de52-bdd5-46ee-9dde-6a521f636abe", "device": "/dev/sdb"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:13:25.084064 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3b5d036c-bc54-46cb-b132-54e1f945283b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:25.090843 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b5d036c-bc54-46cb-b132-54e1f945283b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:25.091328 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b5d036c-bc54-46cb-b132-54e1f945283b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:25.091762 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b5d036c-bc54-46cb-b132-54e1f945283b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:25.092454 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b5d036c-bc54-46cb-b132-54e1f945283b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:25.092904 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b5d036c-bc54-46cb-b132-54e1f945283b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:25.093326 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b5d036c-bc54-46cb-b132-54e1f945283b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:25.328085 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=99,nova_cell1:UPDATE=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:25.606549 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2a73a7c1-7193-4eff-b79e-56cb537e06fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:25.611976 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2a73a7c1-7193-4eff-b79e-56cb537e06fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:25.619242 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2a73a7c1-7193-4eff-b79e-56cb537e06fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:25.619740 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2a73a7c1-7193-4eff-b79e-56cb537e06fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:25.620207 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2a73a7c1-7193-4eff-b79e-56cb537e06fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:25.620946 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2a73a7c1-7193-4eff-b79e-56cb537e06fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:25.621433 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2a73a7c1-7193-4eff-b79e-56cb537e06fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:25.621864 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2a73a7c1-7193-4eff-b79e-56cb537e06fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:25.689645 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2a73a7c1-7193-4eff-b79e-56cb537e06fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:25.697420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2a73a7c1-7193-4eff-b79e-56cb537e06fa tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1462 microversion: 2.1 time: 0.103025 Sep 16 08:13:25.697982 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 544/1035] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:25 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1462 bytes in 105 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:25.713652 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-91fda2eb-1a02-4d29-9e96-2b5ed090ae8e req-ee0d859e-ac17-4186-bc64-20ea7e5e9edc service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "07a2df18-56fc-4d48-9eed-009403b79b7e", "name": "network-vif-deleted", "tag": "fa90d04f-de45-4124-aa59-7ac7f7183407"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:13:25.713652 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-91fda2eb-1a02-4d29-9e96-2b5ed090ae8e req-ee0d859e-ac17-4186-bc64-20ea7e5e9edc service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:25.713652 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-91fda2eb-1a02-4d29-9e96-2b5ed090ae8e req-ee0d859e-ac17-4186-bc64-20ea7e5e9edc service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:25.713652 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-91fda2eb-1a02-4d29-9e96-2b5ed090ae8e req-ee0d859e-ac17-4186-bc64-20ea7e5e9edc service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:25.724357 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-91fda2eb-1a02-4d29-9e96-2b5ed090ae8e req-ee0d859e-ac17-4186-bc64-20ea7e5e9edc service nova] Creating event network-vif-deleted:fa90d04f-de45-4124-aa59-7ac7f7183407 for instance 07a2df18-56fc-4d48-9eed-009403b79b7e on hv-cinder-74014 Sep 16 08:13:25.729908 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-91fda2eb-1a02-4d29-9e96-2b5ed090ae8e req-ee0d859e-ac17-4186-bc64-20ea7e5e9edc service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030821 Sep 16 08:13:25.730706 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 545/1036] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:13:25 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:13:25.947133 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3b5d036c-bc54-46cb-b132-54e1f945283b tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "POST /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.871015 Sep 16 08:13:25.947764 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 492/1037] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:13:25 2022] POST /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29/os-volume_attachments => generated 194 bytes in 873 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:13:26.722137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:26.723263 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:26.730472 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:26.736316 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:26.736316 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:26.736316 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:26.736316 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:26.737116 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:26.737116 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:26.769495 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:26.769994 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:26.770437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:26.770934 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lazy-loading 'fault' on Instance uuid 07a2df18-56fc-4d48-9eed-009403b79b7e {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:13:26.815947 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'e9cd1b533aa8456d95e1bdbeac678b9f', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '9d32f40c2bd64a61aadd27f82d11191a', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:26.823742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-eb986a35-2f18-4d7f-8ffb-226bc7670f37 tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 200 len: 1304 microversion: 2.1 time: 0.106681 Sep 16 08:13:26.824313 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 546/1038] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:26 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 1304 bytes in 108 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:27.849059 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-88f38964-a4da-4311-af0b-71bf997768ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:27.850956 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-88f38964-a4da-4311-af0b-71bf997768ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] [instance: 07a2df18-56fc-4d48-9eed-009403b79b7e] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:27.858140 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-88f38964-a4da-4311-af0b-71bf997768ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:27.858631 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-88f38964-a4da-4311-af0b-71bf997768ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:27.859153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-88f38964-a4da-4311-af0b-71bf997768ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:27.859862 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-88f38964-a4da-4311-af0b-71bf997768ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:27.860319 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-88f38964-a4da-4311-af0b-71bf997768ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:27.860751 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-88f38964-a4da-4311-af0b-71bf997768ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:27.874506 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-88f38964-a4da-4311-af0b-71bf997768ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] HTTP exception thrown: Instance 07a2df18-56fc-4d48-9eed-009403b79b7e could not be found. Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-88f38964-a4da-4311-af0b-71bf997768ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Request method failure captured: Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e HTTP/1.1 Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC_oOwjFQGk1XNqaFO84XWJk7DcugU0YHHuAAS-Qz_B5LhmG--Tyz874eWyKwQrVLwN_jqGiXEymgIrd-9nTjpesSCC6SBG6x1d-UI4BaJQILhDYoQJ-Fb9lD6GGo80lwazq3y-kNC68ri9WDhzz36z3tuba8MagbyXOt8amsPzFgw8 Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 9d32f40c2bd64a61aadd27f82d11191a Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-VolumesActionsTest-878094391 Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:13:27.876184 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:13:27.877938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9d32f40c2bd64a61aadd27f82d11191a"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/9d32f40c2bd64a61aadd27f82d11191a"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_9d32f40c2bd64a61aadd27f82d11191a", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/9d32f40c2bd64a61aadd27f82d11191a"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:13:27.877938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-VolumesActionsTest-878094391 Sep 16 08:13:27.877938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 9d32f40c2bd64a61aadd27f82d11191a Sep 16 08:13:27.877938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-VolumesActionsTest-878094391 Sep 16 08:13:27.877938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-VolumesActionsTest-878094391-project Sep 16 08:13:27.877938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:13:27.877938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:13:27.877938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: e9cd1b533aa8456d95e1bdbeac678b9f Sep 16 08:13:27.877938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-VolumesActionsTest-878094391-project Sep 16 08:13:27.877938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:13:27.877938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 07a2df18-56fc-4d48-9eed-009403b79b7e could not be found. Sep 16 08:13:27.877938 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '07a2df18-56fc-4d48-9eed-009403b79b7e'} Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 07a2df18-56fc-4d48-9eed-009403b79b7e could not be found. Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:13:27.879007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 07a2df18-56fc-4d48-9eed-009403b79b7e could not be found. Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 07a2df18-56fc-4d48-9eed-009403b79b7e could not be found. Sep 16 08:13:27.880617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:13:27.882066 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-88f38964-a4da-4311-af0b-71bf997768ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] Returning 404 to user: Instance 07a2df18-56fc-4d48-9eed-009403b79b7e could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:13:27.882066 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-88f38964-a4da-4311-af0b-71bf997768ec tempest-VolumesActionsTest-878094391 tempest-VolumesActionsTest-878094391-project] 10.222.0.59 "GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e" status: 404 len: 111 microversion: 2.1 time: 0.033682 Sep 16 08:13:27.882066 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 493/1039] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:27 2022] GET /compute/v2.1/servers/07a2df18-56fc-4d48-9eed-009403b79b7e => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:13:28.488181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestVolumeBootPattern-server-759659591", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestVolumeBootPattern-1882303610", "security_groups": [{"name": "tempest-secgroup-smoke-2047951653"}], "block_device_mapping_v2": [{"uuid": "8d4a7fed-bd29-4c48-b8b9-bbd23b98c2d0", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": false}], "networks": [{"uuid": "c3183744-0e74-401e-ac7d-6d88c22643af"}]}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:13:28.615267 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.network.neutron [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] validate_networks() for [('c3183744-0e74-401e-ac7d-6d88c22643af', None, None, None, None, None)] {{(pid=121046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:13:29.012556 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Flavor limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:13:29.012989 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Image limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:13:29.013499 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Flavor pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:13:29.013996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Image pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:13:29.014420 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:13:29.023408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:29.023891 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:29.024331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:29.026597 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:29.026597 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:29.026597 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:29.043525 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Getting quotas for project 794ad972bfa844538f6f71d62e7bd163. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:13:29.047650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Getting quotas for user afbb1d9c9bb34fbd8bfc78710c86d1f5 and project 794ad972bfa844538f6f71d62e7bd163. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:13:29.106731 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Going to run 1 instances... {{(pid=121046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:13:29.108953 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=False,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='8d4a7fed-bd29-4c48-b8b9-bbd23b98c2d0',volume_size=None,volume_type=None)] {{(pid=121046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:13:29.493298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-debdaffd-6c0c-4ab7-bc8d-50ab1ab415f9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 406 microversion: 2.1 time: 1.009008 Sep 16 08:13:29.494104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 547/1040] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:13:28 2022] POST /compute/v2.1/servers => generated 406 bytes in 1010 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:13:29.505199 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-dc360b69-2d98-4cce-b77d-5b92457e3f9e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:29.505875 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-dc360b69-2d98-4cce-b77d-5b92457e3f9e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:29.509715 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=42 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:29.561736 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dc360b69-2d98-4cce-b77d-5b92457e3f9e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:29.568849 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-dc360b69-2d98-4cce-b77d-5b92457e3f9e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1094 microversion: 2.1 time: 0.067338 Sep 16 08:13:29.569424 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 494/1041] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:29 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1094 bytes in 69 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:30.592111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-31163557-3f5c-4708-a269-97f356abc75e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:30.592669 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-31163557-3f5c-4708-a269-97f356abc75e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:30.598705 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31163557-3f5c-4708-a269-97f356abc75e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:30.599200 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31163557-3f5c-4708-a269-97f356abc75e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:30.599671 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31163557-3f5c-4708-a269-97f356abc75e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:30.600377 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31163557-3f5c-4708-a269-97f356abc75e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:30.600841 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31163557-3f5c-4708-a269-97f356abc75e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:30.601276 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-31163557-3f5c-4708-a269-97f356abc75e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:30.660417 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-31163557-3f5c-4708-a269-97f356abc75e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:30.668541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-31163557-3f5c-4708-a269-97f356abc75e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1144 microversion: 2.1 time: 0.080884 Sep 16 08:13:30.669102 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 548/1042] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:30 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1144 bytes in 82 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:31.691106 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b95e0082-3f23-487a-994f-f9b3196a984f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:31.691756 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b95e0082-3f23-487a-994f-f9b3196a984f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:31.699733 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b95e0082-3f23-487a-994f-f9b3196a984f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:31.700220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b95e0082-3f23-487a-994f-f9b3196a984f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:31.700661 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b95e0082-3f23-487a-994f-f9b3196a984f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:31.701355 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b95e0082-3f23-487a-994f-f9b3196a984f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:31.701817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b95e0082-3f23-487a-994f-f9b3196a984f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:31.702246 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b95e0082-3f23-487a-994f-f9b3196a984f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:31.764772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b95e0082-3f23-487a-994f-f9b3196a984f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:31.772677 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b95e0082-3f23-487a-994f-f9b3196a984f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1144 microversion: 2.1 time: 0.085482 Sep 16 08:13:31.773245 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 495/1043] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:31 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1144 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:32.796322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-100d8895-a9d9-41d1-b067-95787cf3e81b tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:32.796925 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-100d8895-a9d9-41d1-b067-95787cf3e81b tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:32.803685 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-100d8895-a9d9-41d1-b067-95787cf3e81b tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:32.804180 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-100d8895-a9d9-41d1-b067-95787cf3e81b tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:32.804625 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-100d8895-a9d9-41d1-b067-95787cf3e81b tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:32.805329 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-100d8895-a9d9-41d1-b067-95787cf3e81b tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:32.805846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-100d8895-a9d9-41d1-b067-95787cf3e81b tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:32.806252 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-100d8895-a9d9-41d1-b067-95787cf3e81b tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:32.868710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-100d8895-a9d9-41d1-b067-95787cf3e81b tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:32.877029 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-100d8895-a9d9-41d1-b067-95787cf3e81b tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1136 microversion: 2.1 time: 0.084583 Sep 16 08:13:32.877595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 549/1044] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:32 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1136 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:33.900507 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f895c164-250a-466f-ba2c-302a80032794 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:33.901244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f895c164-250a-466f-ba2c-302a80032794 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:33.908148 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f895c164-250a-466f-ba2c-302a80032794 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:33.908658 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f895c164-250a-466f-ba2c-302a80032794 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:33.909095 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f895c164-250a-466f-ba2c-302a80032794 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:33.909791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f895c164-250a-466f-ba2c-302a80032794 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:33.910292 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f895c164-250a-466f-ba2c-302a80032794 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:33.910726 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f895c164-250a-466f-ba2c-302a80032794 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:33.978073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f895c164-250a-466f-ba2c-302a80032794 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:33.985707 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f895c164-250a-466f-ba2c-302a80032794 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1192 microversion: 2.1 time: 0.089226 Sep 16 08:13:33.986276 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 496/1045] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:33 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1192 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:35.008838 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-68128503-1c3a-4134-a993-d4661b845673 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:35.010705 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-68128503-1c3a-4134-a993-d4661b845673 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:35.022190 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68128503-1c3a-4134-a993-d4661b845673 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:35.023238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68128503-1c3a-4134-a993-d4661b845673 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:35.025074 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68128503-1c3a-4134-a993-d4661b845673 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:35.027236 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68128503-1c3a-4134-a993-d4661b845673 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:35.028130 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68128503-1c3a-4134-a993-d4661b845673 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:35.030823 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68128503-1c3a-4134-a993-d4661b845673 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:35.137266 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-68128503-1c3a-4134-a993-d4661b845673 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:35.155086 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-68128503-1c3a-4134-a993-d4661b845673 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1210 microversion: 2.1 time: 0.150301 Sep 16 08:13:35.155985 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 550/1046] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:35 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1210 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:36.179531 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-52972ba5-2e78-4d9c-a6ea-6a5fc8e8a48f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:36.180259 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-52972ba5-2e78-4d9c-a6ea-6a5fc8e8a48f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:36.187597 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-52972ba5-2e78-4d9c-a6ea-6a5fc8e8a48f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:36.188874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-52972ba5-2e78-4d9c-a6ea-6a5fc8e8a48f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:36.188874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-52972ba5-2e78-4d9c-a6ea-6a5fc8e8a48f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:36.189818 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-52972ba5-2e78-4d9c-a6ea-6a5fc8e8a48f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:36.190501 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-52972ba5-2e78-4d9c-a6ea-6a5fc8e8a48f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:36.191142 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-52972ba5-2e78-4d9c-a6ea-6a5fc8e8a48f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:36.329719 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-52972ba5-2e78-4d9c-a6ea-6a5fc8e8a48f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:36.340183 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-52972ba5-2e78-4d9c-a6ea-6a5fc8e8a48f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1278 microversion: 2.1 time: 0.165050 Sep 16 08:13:36.355164 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 497/1047] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:36 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1278 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:36.927779 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-58a73358-8b7b-4965-8b19-a8c7efdc72d3 req-fd830ec1-4e49-43f1-b2a6-b1bb4e2d725f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e50a639-a343-4b0e-86fe-9dce43fcc147", "tag": "27297ab7-03c2-443e-8e58-5bfab33fa167"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:13:36.941964 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-58a73358-8b7b-4965-8b19-a8c7efdc72d3 req-fd830ec1-4e49-43f1-b2a6-b1bb4e2d725f service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:36.944156 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-58a73358-8b7b-4965-8b19-a8c7efdc72d3 req-fd830ec1-4e49-43f1-b2a6-b1bb4e2d725f service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:36.944827 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-58a73358-8b7b-4965-8b19-a8c7efdc72d3 req-fd830ec1-4e49-43f1-b2a6-b1bb4e2d725f service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:36.964253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-58a73358-8b7b-4965-8b19-a8c7efdc72d3 req-fd830ec1-4e49-43f1-b2a6-b1bb4e2d725f service nova] Creating event network-changed:27297ab7-03c2-443e-8e58-5bfab33fa167 for instance 2e50a639-a343-4b0e-86fe-9dce43fcc147 on hv-cinder-74014 Sep 16 08:13:36.969617 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-58a73358-8b7b-4965-8b19-a8c7efdc72d3 req-fd830ec1-4e49-43f1-b2a6-b1bb4e2d725f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.046866 Sep 16 08:13:36.970435 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 551/1048] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:13:36 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:13:37.364799 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fffcd9a6-ca57-4f49-85c0-34a267655a69 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:37.365559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-fffcd9a6-ca57-4f49-85c0-34a267655a69 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:37.372608 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fffcd9a6-ca57-4f49-85c0-34a267655a69 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:37.373107 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fffcd9a6-ca57-4f49-85c0-34a267655a69 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:37.373550 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fffcd9a6-ca57-4f49-85c0-34a267655a69 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:37.374275 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fffcd9a6-ca57-4f49-85c0-34a267655a69 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:37.374761 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fffcd9a6-ca57-4f49-85c0-34a267655a69 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:37.375199 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fffcd9a6-ca57-4f49-85c0-34a267655a69 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:37.540516 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fffcd9a6-ca57-4f49-85c0-34a267655a69 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:37.549803 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-fffcd9a6-ca57-4f49-85c0-34a267655a69 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.189245 Sep 16 08:13:37.550984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 498/1049] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:37 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:38.582882 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-00aec8e3-2ac6-4c49-b5af-998a207a14f3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:38.583717 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-00aec8e3-2ac6-4c49-b5af-998a207a14f3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:38.590861 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00aec8e3-2ac6-4c49-b5af-998a207a14f3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:38.591555 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00aec8e3-2ac6-4c49-b5af-998a207a14f3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:38.592170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00aec8e3-2ac6-4c49-b5af-998a207a14f3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:38.596938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00aec8e3-2ac6-4c49-b5af-998a207a14f3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:38.597984 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00aec8e3-2ac6-4c49-b5af-998a207a14f3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:38.598500 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-00aec8e3-2ac6-4c49-b5af-998a207a14f3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:38.752328 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-00aec8e3-2ac6-4c49-b5af-998a207a14f3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:38.762571 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-00aec8e3-2ac6-4c49-b5af-998a207a14f3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.185251 Sep 16 08:13:38.764876 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 552/1050] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:38 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 188 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:39.787328 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c8d79b77-ddb0-454b-9bd4-c09e2cca93bf tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:39.788802 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c8d79b77-ddb0-454b-9bd4-c09e2cca93bf tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:39.791984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:39.797500 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c8d79b77-ddb0-454b-9bd4-c09e2cca93bf tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:39.798482 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c8d79b77-ddb0-454b-9bd4-c09e2cca93bf tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:39.799136 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c8d79b77-ddb0-454b-9bd4-c09e2cca93bf tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:39.800097 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c8d79b77-ddb0-454b-9bd4-c09e2cca93bf tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:39.800722 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c8d79b77-ddb0-454b-9bd4-c09e2cca93bf tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:39.801322 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c8d79b77-ddb0-454b-9bd4-c09e2cca93bf tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:39.990903 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c8d79b77-ddb0-454b-9bd4-c09e2cca93bf tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:40.000812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c8d79b77-ddb0-454b-9bd4-c09e2cca93bf tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.218086 Sep 16 08:13:40.001706 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 499/1051] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:39 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 219 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:41.024508 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-753d86aa-ba29-4872-b3ca-44eb81934418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:41.025572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-753d86aa-ba29-4872-b3ca-44eb81934418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:41.028715 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:41.029496 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=6 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:41.036374 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-753d86aa-ba29-4872-b3ca-44eb81934418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:41.037876 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-753d86aa-ba29-4872-b3ca-44eb81934418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:41.038606 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-753d86aa-ba29-4872-b3ca-44eb81934418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:41.039590 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-753d86aa-ba29-4872-b3ca-44eb81934418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:41.040253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-753d86aa-ba29-4872-b3ca-44eb81934418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:41.040894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-753d86aa-ba29-4872-b3ca-44eb81934418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:41.185883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-753d86aa-ba29-4872-b3ca-44eb81934418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:41.205158 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-753d86aa-ba29-4872-b3ca-44eb81934418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.185244 Sep 16 08:13:41.215532 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 553/1052] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:41 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 196 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:42.230212 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-68ec2f9d-4ffd-4d39-bbaa-d314de196700 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:42.230986 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-68ec2f9d-4ffd-4d39-bbaa-d314de196700 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:42.237750 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-68ec2f9d-4ffd-4d39-bbaa-d314de196700 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:42.238350 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-68ec2f9d-4ffd-4d39-bbaa-d314de196700 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:42.238918 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-68ec2f9d-4ffd-4d39-bbaa-d314de196700 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:42.240220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-68ec2f9d-4ffd-4d39-bbaa-d314de196700 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:42.240901 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-68ec2f9d-4ffd-4d39-bbaa-d314de196700 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:42.241458 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-68ec2f9d-4ffd-4d39-bbaa-d314de196700 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:42.404713 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-68ec2f9d-4ffd-4d39-bbaa-d314de196700 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:42.413438 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-68ec2f9d-4ffd-4d39-bbaa-d314de196700 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.187776 Sep 16 08:13:42.414455 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 500/1053] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:42 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:43.439226 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-238a5bfa-c3c6-4d7a-bcf2-328f7be11522 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:43.439855 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-238a5bfa-c3c6-4d7a-bcf2-328f7be11522 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:43.447723 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-238a5bfa-c3c6-4d7a-bcf2-328f7be11522 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:43.448677 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-238a5bfa-c3c6-4d7a-bcf2-328f7be11522 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:43.449141 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-238a5bfa-c3c6-4d7a-bcf2-328f7be11522 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:43.449884 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-238a5bfa-c3c6-4d7a-bcf2-328f7be11522 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:43.450361 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-238a5bfa-c3c6-4d7a-bcf2-328f7be11522 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:43.450829 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-238a5bfa-c3c6-4d7a-bcf2-328f7be11522 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:43.606602 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-238a5bfa-c3c6-4d7a-bcf2-328f7be11522 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:43.619313 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-238a5bfa-c3c6-4d7a-bcf2-328f7be11522 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.183675 Sep 16 08:13:43.620148 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 554/1054] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:43 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:44.644837 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fb40a895-e296-412f-8a2b-ff10966abf30 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:44.646216 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-fb40a895-e296-412f-8a2b-ff10966abf30 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:44.654383 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb40a895-e296-412f-8a2b-ff10966abf30 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:44.654903 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb40a895-e296-412f-8a2b-ff10966abf30 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:44.655356 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb40a895-e296-412f-8a2b-ff10966abf30 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:44.656211 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb40a895-e296-412f-8a2b-ff10966abf30 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:44.656689 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb40a895-e296-412f-8a2b-ff10966abf30 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:44.657123 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fb40a895-e296-412f-8a2b-ff10966abf30 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:44.847981 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fb40a895-e296-412f-8a2b-ff10966abf30 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:44.856835 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-fb40a895-e296-412f-8a2b-ff10966abf30 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.215938 Sep 16 08:13:44.862769 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 501/1055] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:44 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 217 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:45.883137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-fd820c86-d2a6-4552-815f-0b2bc88f88ce tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:45.883683 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-fd820c86-d2a6-4552-815f-0b2bc88f88ce tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:45.890289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fd820c86-d2a6-4552-815f-0b2bc88f88ce tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:45.896400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fd820c86-d2a6-4552-815f-0b2bc88f88ce tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:45.896400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fd820c86-d2a6-4552-815f-0b2bc88f88ce tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:45.896400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fd820c86-d2a6-4552-815f-0b2bc88f88ce tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:45.896400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fd820c86-d2a6-4552-815f-0b2bc88f88ce tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:45.896757 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-fd820c86-d2a6-4552-815f-0b2bc88f88ce tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:46.038632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-fd820c86-d2a6-4552-815f-0b2bc88f88ce tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:46.048065 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-fd820c86-d2a6-4552-815f-0b2bc88f88ce tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.168944 Sep 16 08:13:46.048739 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 555/1056] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:45 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 170 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:47.071608 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7c6ccbc0-bbb1-4fa6-a6de-02b980adcbe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:47.073350 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7c6ccbc0-bbb1-4fa6-a6de-02b980adcbe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:47.080117 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7c6ccbc0-bbb1-4fa6-a6de-02b980adcbe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:47.080602 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7c6ccbc0-bbb1-4fa6-a6de-02b980adcbe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:47.081044 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7c6ccbc0-bbb1-4fa6-a6de-02b980adcbe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:47.081741 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7c6ccbc0-bbb1-4fa6-a6de-02b980adcbe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:47.082212 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7c6ccbc0-bbb1-4fa6-a6de-02b980adcbe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:47.082665 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7c6ccbc0-bbb1-4fa6-a6de-02b980adcbe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:47.225028 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7c6ccbc0-bbb1-4fa6-a6de-02b980adcbe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:47.233861 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7c6ccbc0-bbb1-4fa6-a6de-02b980adcbe1 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.166151 Sep 16 08:13:47.236940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 502/1057] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:47 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:48.257501 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c8695fdb-b3dd-4e59-b695-d4635ec910d7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:48.258903 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c8695fdb-b3dd-4e59-b695-d4635ec910d7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:48.265583 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c8695fdb-b3dd-4e59-b695-d4635ec910d7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:48.272759 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c8695fdb-b3dd-4e59-b695-d4635ec910d7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:48.272759 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c8695fdb-b3dd-4e59-b695-d4635ec910d7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:48.272759 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c8695fdb-b3dd-4e59-b695-d4635ec910d7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:48.272759 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c8695fdb-b3dd-4e59-b695-d4635ec910d7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:48.273118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c8695fdb-b3dd-4e59-b695-d4635ec910d7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:48.410796 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c8695fdb-b3dd-4e59-b695-d4635ec910d7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:48.419903 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c8695fdb-b3dd-4e59-b695-d4635ec910d7 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.166428 Sep 16 08:13:48.420840 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 556/1058] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:48 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:49.444650 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c228a992-f07b-4278-bac4-93ec5be7f29f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:49.445463 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c228a992-f07b-4278-bac4-93ec5be7f29f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:49.453377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c228a992-f07b-4278-bac4-93ec5be7f29f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:49.453984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c228a992-f07b-4278-bac4-93ec5be7f29f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:49.454561 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c228a992-f07b-4278-bac4-93ec5be7f29f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:49.455399 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c228a992-f07b-4278-bac4-93ec5be7f29f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:49.456101 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c228a992-f07b-4278-bac4-93ec5be7f29f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:49.456764 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c228a992-f07b-4278-bac4-93ec5be7f29f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:49.608179 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c228a992-f07b-4278-bac4-93ec5be7f29f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:49.616945 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c228a992-f07b-4278-bac4-93ec5be7f29f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.176946 Sep 16 08:13:49.617864 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 503/1059] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:49 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:50.641146 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f0877a59-5d29-480b-a4b4-f5f83c77d48e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:50.642029 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f0877a59-5d29-480b-a4b4-f5f83c77d48e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:50.649098 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f0877a59-5d29-480b-a4b4-f5f83c77d48e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:50.649847 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f0877a59-5d29-480b-a4b4-f5f83c77d48e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:50.650297 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f0877a59-5d29-480b-a4b4-f5f83c77d48e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:50.651061 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f0877a59-5d29-480b-a4b4-f5f83c77d48e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:50.651692 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f0877a59-5d29-480b-a4b4-f5f83c77d48e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:50.653264 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f0877a59-5d29-480b-a4b4-f5f83c77d48e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:50.806850 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f0877a59-5d29-480b-a4b4-f5f83c77d48e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:50.814612 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f0877a59-5d29-480b-a4b4-f5f83c77d48e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.177431 Sep 16 08:13:50.815206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 557/1060] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:50 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 179 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:51.837634 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6634f9c5-fb72-4b3a-9fdc-e54747abb44f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:51.839087 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6634f9c5-fb72-4b3a-9fdc-e54747abb44f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:51.847164 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6634f9c5-fb72-4b3a-9fdc-e54747abb44f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:51.847657 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6634f9c5-fb72-4b3a-9fdc-e54747abb44f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:51.848100 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6634f9c5-fb72-4b3a-9fdc-e54747abb44f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:51.848866 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6634f9c5-fb72-4b3a-9fdc-e54747abb44f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:51.849494 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6634f9c5-fb72-4b3a-9fdc-e54747abb44f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:51.849930 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6634f9c5-fb72-4b3a-9fdc-e54747abb44f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:51.995408 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6634f9c5-fb72-4b3a-9fdc-e54747abb44f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:52.003853 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6634f9c5-fb72-4b3a-9fdc-e54747abb44f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.170196 Sep 16 08:13:52.004500 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 504/1061] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:51 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 171 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:53.027571 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-53c0b58b-d8d7-450b-9b86-571bfbda7418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:53.028831 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-53c0b58b-d8d7-450b-9b86-571bfbda7418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:53.035381 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-53c0b58b-d8d7-450b-9b86-571bfbda7418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:53.035871 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-53c0b58b-d8d7-450b-9b86-571bfbda7418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:53.036371 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-53c0b58b-d8d7-450b-9b86-571bfbda7418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:53.037074 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-53c0b58b-d8d7-450b-9b86-571bfbda7418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:53.037535 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-53c0b58b-d8d7-450b-9b86-571bfbda7418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:53.037966 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-53c0b58b-d8d7-450b-9b86-571bfbda7418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:53.171748 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-53c0b58b-d8d7-450b-9b86-571bfbda7418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:53.179695 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-53c0b58b-d8d7-450b-9b86-571bfbda7418 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.156255 Sep 16 08:13:53.180257 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 558/1062] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:53 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:53.537141 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-01fc638c-9511-4cca-9718-be6890f76cfe tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:53.537881 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-01fc638c-9511-4cca-9718-be6890f76cfe tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:53.545000 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01fc638c-9511-4cca-9718-be6890f76cfe tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:53.545524 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01fc638c-9511-4cca-9718-be6890f76cfe tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:53.545998 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01fc638c-9511-4cca-9718-be6890f76cfe tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:53.546740 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01fc638c-9511-4cca-9718-be6890f76cfe tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:53.547208 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01fc638c-9511-4cca-9718-be6890f76cfe tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:53.547671 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-01fc638c-9511-4cca-9718-be6890f76cfe tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:53.629680 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-01fc638c-9511-4cca-9718-be6890f76cfe tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lazy-loading 'services' on Instance uuid 8e9494f9-9706-4af0-b4ef-dac0291aae29 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:13:53.844203 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-01fc638c-9511-4cca-9718-be6890f76cfe tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29/os-volume_attachments/8c52de52-bdd5-46ee-9dde-6a521f636abe" status: 202 len: 0 microversion: 2.1 time: 0.310858 Sep 16 08:13:53.844843 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 505/1063] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Sep 16 08:13:53 2022] DELETE /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29/os-volume_attachments/8c52de52-bdd5-46ee-9dde-6a521f636abe => generated 0 bytes in 312 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:13:54.183789 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-303f4b29-76a2-4903-b38b-fbf00cad3f01 req-78bb3d3a-c8cb-4d94-acec-3d46401f6041 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e50a639-a343-4b0e-86fe-9dce43fcc147", "name": "network-vif-plugged", "status": "completed", "tag": "27297ab7-03c2-443e-8e58-5bfab33fa167"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:13:54.189129 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=54,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:54.194522 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-303f4b29-76a2-4903-b38b-fbf00cad3f01 req-78bb3d3a-c8cb-4d94-acec-3d46401f6041 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:54.195062 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-303f4b29-76a2-4903-b38b-fbf00cad3f01 req-78bb3d3a-c8cb-4d94-acec-3d46401f6041 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:54.195497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-303f4b29-76a2-4903-b38b-fbf00cad3f01 req-78bb3d3a-c8cb-4d94-acec-3d46401f6041 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:54.202865 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2dc32858-720e-4a7a-b2a4-4d0621b32942 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:54.203681 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2dc32858-720e-4a7a-b2a4-4d0621b32942 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:54.207111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-303f4b29-76a2-4903-b38b-fbf00cad3f01 req-78bb3d3a-c8cb-4d94-acec-3d46401f6041 service nova] Creating event network-vif-plugged:27297ab7-03c2-443e-8e58-5bfab33fa167 for instance 2e50a639-a343-4b0e-86fe-9dce43fcc147 on hv-cinder-74014 Sep 16 08:13:54.213768 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2dc32858-720e-4a7a-b2a4-4d0621b32942 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:54.213768 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2dc32858-720e-4a7a-b2a4-4d0621b32942 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:54.213768 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2dc32858-720e-4a7a-b2a4-4d0621b32942 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:54.214114 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-303f4b29-76a2-4903-b38b-fbf00cad3f01 req-78bb3d3a-c8cb-4d94-acec-3d46401f6041 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032078 Sep 16 08:13:54.214221 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2dc32858-720e-4a7a-b2a4-4d0621b32942 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:54.214328 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 559/1064] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:13:54 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:13:54.214423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2dc32858-720e-4a7a-b2a4-4d0621b32942 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:54.214423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2dc32858-720e-4a7a-b2a4-4d0621b32942 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:54.355410 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2dc32858-720e-4a7a-b2a4-4d0621b32942 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:54.363648 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2dc32858-720e-4a7a-b2a4-4d0621b32942 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.165246 Sep 16 08:13:54.364325 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 506/1065] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:54 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:13:55.386506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-17bbf31f-f4e6-4a1b-96fb-f5249a8998d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:55.387788 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-17bbf31f-f4e6-4a1b-96fb-f5249a8998d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:55.394466 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-17bbf31f-f4e6-4a1b-96fb-f5249a8998d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:55.394988 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-17bbf31f-f4e6-4a1b-96fb-f5249a8998d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:55.395439 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-17bbf31f-f4e6-4a1b-96fb-f5249a8998d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:55.396165 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-17bbf31f-f4e6-4a1b-96fb-f5249a8998d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:55.396633 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-17bbf31f-f4e6-4a1b-96fb-f5249a8998d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:55.397073 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-17bbf31f-f4e6-4a1b-96fb-f5249a8998d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:55.535209 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-17bbf31f-f4e6-4a1b-96fb-f5249a8998d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:55.543493 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-17bbf31f-f4e6-4a1b-96fb-f5249a8998d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.161719 Sep 16 08:13:55.544148 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 560/1066] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:55 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:56.038697 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-98e3b686-1cd0-432a-b769-51ef1fee82f1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:56.039229 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-98e3b686-1cd0-432a-b769-51ef1fee82f1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:56.046073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-98e3b686-1cd0-432a-b769-51ef1fee82f1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:56.046554 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-98e3b686-1cd0-432a-b769-51ef1fee82f1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:56.047041 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-98e3b686-1cd0-432a-b769-51ef1fee82f1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:56.047788 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-98e3b686-1cd0-432a-b769-51ef1fee82f1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:56.048237 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-98e3b686-1cd0-432a-b769-51ef1fee82f1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:56.048660 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-98e3b686-1cd0-432a-b769-51ef1fee82f1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:56.051333 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=81,nova_cell1:UPDATE=1,nova_cell1:INSERT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:56.076468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-98e3b686-1cd0-432a-b769-51ef1fee82f1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Going to try to terminate instance {{(pid=121047) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:13:56.398791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-98e3b686-1cd0-432a-b769-51ef1fee82f1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "DELETE /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 204 len: 0 microversion: 2.1 time: 0.363582 Sep 16 08:13:56.399393 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 507/1067] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:13:56 2022] DELETE /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 0 bytes in 365 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:13:56.408199 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-da47165c-1c26-4620-83c3-ef86bad4a0a4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:56.408815 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-da47165c-1c26-4620-83c3-ef86bad4a0a4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:56.415274 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da47165c-1c26-4620-83c3-ef86bad4a0a4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:56.419238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da47165c-1c26-4620-83c3-ef86bad4a0a4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:56.419238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da47165c-1c26-4620-83c3-ef86bad4a0a4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:56.419238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da47165c-1c26-4620-83c3-ef86bad4a0a4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:56.419238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da47165c-1c26-4620-83c3-ef86bad4a0a4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:56.419594 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-da47165c-1c26-4620-83c3-ef86bad4a0a4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:56.554436 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-da47165c-1c26-4620-83c3-ef86bad4a0a4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:56.564169 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-da47165c-1c26-4620-83c3-ef86bad4a0a4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1513 microversion: 2.1 time: 0.159729 Sep 16 08:13:56.566537 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-fcea9616-9353-4360-9e38-f8ff6695dd24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:56.566776 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 561/1068] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:56 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1513 bytes in 163 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:56.568203 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-fcea9616-9353-4360-9e38-f8ff6695dd24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:56.575168 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fcea9616-9353-4360-9e38-f8ff6695dd24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:56.575871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fcea9616-9353-4360-9e38-f8ff6695dd24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:56.576311 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fcea9616-9353-4360-9e38-f8ff6695dd24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:56.577010 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fcea9616-9353-4360-9e38-f8ff6695dd24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:56.577585 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fcea9616-9353-4360-9e38-f8ff6695dd24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:56.578011 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-fcea9616-9353-4360-9e38-f8ff6695dd24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:56.718513 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-fcea9616-9353-4360-9e38-f8ff6695dd24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:56.726841 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-fcea9616-9353-4360-9e38-f8ff6695dd24 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1266 microversion: 2.1 time: 0.164438 Sep 16 08:13:56.732341 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 508/1069] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:56 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1266 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:13:57.588212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ff4bedc7-6ae2-4413-936a-1795b0155aa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:57.588868 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ff4bedc7-6ae2-4413-936a-1795b0155aa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:57.595800 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff4bedc7-6ae2-4413-936a-1795b0155aa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:57.596293 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff4bedc7-6ae2-4413-936a-1795b0155aa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:57.596806 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff4bedc7-6ae2-4413-936a-1795b0155aa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:57.597508 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff4bedc7-6ae2-4413-936a-1795b0155aa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:57.597974 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff4bedc7-6ae2-4413-936a-1795b0155aa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:57.598470 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff4bedc7-6ae2-4413-936a-1795b0155aa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:57.723770 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ff4bedc7-6ae2-4413-936a-1795b0155aa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:57.731592 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ff4bedc7-6ae2-4413-936a-1795b0155aa3 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1513 microversion: 2.1 time: 0.147321 Sep 16 08:13:57.732808 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 562/1070] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:57 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1513 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:57.749415 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-63460ccb-d9bd-4552-a198-9d7c9d31e638 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:57.750080 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-63460ccb-d9bd-4552-a198-9d7c9d31e638 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:57.756559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-63460ccb-d9bd-4552-a198-9d7c9d31e638 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:57.757038 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-63460ccb-d9bd-4552-a198-9d7c9d31e638 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:57.757471 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-63460ccb-d9bd-4552-a198-9d7c9d31e638 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:57.758159 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-63460ccb-d9bd-4552-a198-9d7c9d31e638 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:57.758610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-63460ccb-d9bd-4552-a198-9d7c9d31e638 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:57.759061 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-63460ccb-d9bd-4552-a198-9d7c9d31e638 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:57.889093 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-63460ccb-d9bd-4552-a198-9d7c9d31e638 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:57.896806 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-63460ccb-d9bd-4552-a198-9d7c9d31e638 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1453 microversion: 2.1 time: 0.151379 Sep 16 08:13:57.897363 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 509/1071] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:57 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1453 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:57.920336 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7050c9ee-4c23-4d72-8eb6-fef31d22ff3f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:57.920953 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-7050c9ee-4c23-4d72-8eb6-fef31d22ff3f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:57.926963 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7050c9ee-4c23-4d72-8eb6-fef31d22ff3f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:57.927393 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7050c9ee-4c23-4d72-8eb6-fef31d22ff3f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:57.927844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7050c9ee-4c23-4d72-8eb6-fef31d22ff3f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:57.928547 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7050c9ee-4c23-4d72-8eb6-fef31d22ff3f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:57.929010 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7050c9ee-4c23-4d72-8eb6-fef31d22ff3f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:57.929440 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-7050c9ee-4c23-4d72-8eb6-fef31d22ff3f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:58.061690 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-7050c9ee-4c23-4d72-8eb6-fef31d22ff3f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:58.069817 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7050c9ee-4c23-4d72-8eb6-fef31d22ff3f tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1453 microversion: 2.1 time: 0.153866 Sep 16 08:13:58.070391 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 563/1072] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:57 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1453 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:13:58.756308 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-15508c21-62be-4740-ae1f-3ebe3c0b6561 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:58.757086 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-15508c21-62be-4740-ae1f-3ebe3c0b6561 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:58.764183 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-15508c21-62be-4740-ae1f-3ebe3c0b6561 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:58.764765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-15508c21-62be-4740-ae1f-3ebe3c0b6561 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:58.765641 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-15508c21-62be-4740-ae1f-3ebe3c0b6561 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:58.766668 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-15508c21-62be-4740-ae1f-3ebe3c0b6561 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:58.767222 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-15508c21-62be-4740-ae1f-3ebe3c0b6561 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:58.767945 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-15508c21-62be-4740-ae1f-3ebe3c0b6561 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:58.903095 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-15508c21-62be-4740-ae1f-3ebe3c0b6561 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:13:58.911019 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-15508c21-62be-4740-ae1f-3ebe3c0b6561 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1513 microversion: 2.1 time: 0.159098 Sep 16 08:13:58.911592 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 510/1073] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:58 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1513 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:13:59.624137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-cd00dc9f-c9ba-4de8-91a8-4d033ab8f942 req-83384362-e90f-40c6-bc61-488954a55f28 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "8e9494f9-9706-4af0-b4ef-dac0291aae29", "name": "network-vif-deleted", "tag": "cccafc8a-5a37-4427-8386-89051058ea81"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:13:59.633846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-cd00dc9f-c9ba-4de8-91a8-4d033ab8f942 req-83384362-e90f-40c6-bc61-488954a55f28 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:59.634341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-cd00dc9f-c9ba-4de8-91a8-4d033ab8f942 req-83384362-e90f-40c6-bc61-488954a55f28 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:59.634994 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-cd00dc9f-c9ba-4de8-91a8-4d033ab8f942 req-83384362-e90f-40c6-bc61-488954a55f28 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:59.639282 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=98 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:59.646966 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-cd00dc9f-c9ba-4de8-91a8-4d033ab8f942 req-83384362-e90f-40c6-bc61-488954a55f28 service nova] Creating event network-vif-deleted:cccafc8a-5a37-4427-8386-89051058ea81 for instance 8e9494f9-9706-4af0-b4ef-dac0291aae29 on hv-cinder-74014 Sep 16 08:13:59.652022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-cd00dc9f-c9ba-4de8-91a8-4d033ab8f942 req-83384362-e90f-40c6-bc61-488954a55f28 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.031703 Sep 16 08:13:59.652895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 564/1074] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:13:59 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:13:59.935610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5f2c8420-2d5e-452a-8476-167e70a98f54 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:13:59.936237 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5f2c8420-2d5e-452a-8476-167e70a98f54 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:13:59.938744 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=41,nova_api:UPDATE=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:13:59.943627 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5f2c8420-2d5e-452a-8476-167e70a98f54 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:59.944148 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5f2c8420-2d5e-452a-8476-167e70a98f54 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:59.944595 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5f2c8420-2d5e-452a-8476-167e70a98f54 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:13:59.949012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5f2c8420-2d5e-452a-8476-167e70a98f54 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:13:59.949012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5f2c8420-2d5e-452a-8476-167e70a98f54 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:13:59.949012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5f2c8420-2d5e-452a-8476-167e70a98f54 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:00.008877 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5f2c8420-2d5e-452a-8476-167e70a98f54 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:00.017706 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5f2c8420-2d5e-452a-8476-167e70a98f54 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1471 microversion: 2.1 time: 0.086509 Sep 16 08:14:00.018282 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 511/1075] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:13:59 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1471 bytes in 88 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:01.041930 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3dd0cd56-d818-4573-b982-c74fcdfe91c0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:01.042606 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3dd0cd56-d818-4573-b982-c74fcdfe91c0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:01.049194 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3dd0cd56-d818-4573-b982-c74fcdfe91c0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:01.049687 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3dd0cd56-d818-4573-b982-c74fcdfe91c0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:01.050135 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3dd0cd56-d818-4573-b982-c74fcdfe91c0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:01.050860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3dd0cd56-d818-4573-b982-c74fcdfe91c0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:01.051333 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3dd0cd56-d818-4573-b982-c74fcdfe91c0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:01.051765 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3dd0cd56-d818-4573-b982-c74fcdfe91c0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:01.114410 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3dd0cd56-d818-4573-b982-c74fcdfe91c0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:01.122359 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3dd0cd56-d818-4573-b982-c74fcdfe91c0 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1471 microversion: 2.1 time: 0.085431 Sep 16 08:14:01.123026 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 565/1076] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:01 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1471 bytes in 87 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:01.667311 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-38ae5c2b-cc9b-4636-ba2a-3a91044ff476 req-0153e8db-ee10-440f-903f-ed9163b2ca39 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e50a639-a343-4b0e-86fe-9dce43fcc147", "tag": "27297ab7-03c2-443e-8e58-5bfab33fa167"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:14:01.677074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-38ae5c2b-cc9b-4636-ba2a-3a91044ff476 req-0153e8db-ee10-440f-903f-ed9163b2ca39 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:01.677556 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-38ae5c2b-cc9b-4636-ba2a-3a91044ff476 req-0153e8db-ee10-440f-903f-ed9163b2ca39 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:01.677989 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-38ae5c2b-cc9b-4636-ba2a-3a91044ff476 req-0153e8db-ee10-440f-903f-ed9163b2ca39 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:01.689255 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-38ae5c2b-cc9b-4636-ba2a-3a91044ff476 req-0153e8db-ee10-440f-903f-ed9163b2ca39 service nova] Creating event network-changed:27297ab7-03c2-443e-8e58-5bfab33fa167 for instance 2e50a639-a343-4b0e-86fe-9dce43fcc147 on hv-cinder-74014 Sep 16 08:14:01.694179 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-38ae5c2b-cc9b-4636-ba2a-3a91044ff476 req-0153e8db-ee10-440f-903f-ed9163b2ca39 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.030619 Sep 16 08:14:01.694766 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 512/1077] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:14:01 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:14:02.145424 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6de9c47e-4d34-4b20-a71a-f4dbf5d78351 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:02.146771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6de9c47e-4d34-4b20-a71a-f4dbf5d78351 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:02.154291 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6de9c47e-4d34-4b20-a71a-f4dbf5d78351 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:02.163040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6de9c47e-4d34-4b20-a71a-f4dbf5d78351 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:02.163040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6de9c47e-4d34-4b20-a71a-f4dbf5d78351 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:02.163040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6de9c47e-4d34-4b20-a71a-f4dbf5d78351 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:02.163040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6de9c47e-4d34-4b20-a71a-f4dbf5d78351 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:02.163435 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6de9c47e-4d34-4b20-a71a-f4dbf5d78351 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:02.233029 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6de9c47e-4d34-4b20-a71a-f4dbf5d78351 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:02.240780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6de9c47e-4d34-4b20-a71a-f4dbf5d78351 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1471 microversion: 2.1 time: 0.099243 Sep 16 08:14:02.241356 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 566/1078] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:02 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1471 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:02.340622 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-dae20253-adf5-4de9-8efd-32b6c7f05366 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:02.344800 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-dae20253-adf5-4de9-8efd-32b6c7f05366 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:02.349120 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dae20253-adf5-4de9-8efd-32b6c7f05366 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:02.349605 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dae20253-adf5-4de9-8efd-32b6c7f05366 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:02.350073 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dae20253-adf5-4de9-8efd-32b6c7f05366 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:02.350793 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dae20253-adf5-4de9-8efd-32b6c7f05366 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:02.351247 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dae20253-adf5-4de9-8efd-32b6c7f05366 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:02.351678 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dae20253-adf5-4de9-8efd-32b6c7f05366 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:02.382610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-dae20253-adf5-4de9-8efd-32b6c7f05366 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/os-volume_attachments" status: 200 len: 25 microversion: 2.20 time: 0.046375 Sep 16 08:14:02.383138 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 513/1079] 10.222.0.59 () {60 vars in 1343 bytes} [Fri Sep 16 08:14:02 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360/os-volume_attachments => generated 25 bytes in 48 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:02.448979 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4ac4fbbd-4f99-4c31-97f2-11eeacdc7c91 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:02.449496 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4ac4fbbd-4f99-4c31-97f2-11eeacdc7c91 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:02.456244 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ac4fbbd-4f99-4c31-97f2-11eeacdc7c91 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:02.457037 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ac4fbbd-4f99-4c31-97f2-11eeacdc7c91 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:02.457473 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ac4fbbd-4f99-4c31-97f2-11eeacdc7c91 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:02.458349 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ac4fbbd-4f99-4c31-97f2-11eeacdc7c91 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:02.459031 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ac4fbbd-4f99-4c31-97f2-11eeacdc7c91 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:02.459473 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ac4fbbd-4f99-4c31-97f2-11eeacdc7c91 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:02.488928 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4ac4fbbd-4f99-4c31-97f2-11eeacdc7c91 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:14:02.695794 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4ac4fbbd-4f99-4c31-97f2-11eeacdc7c91 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 204 len: 0 microversion: 2.20 time: 0.250686 Sep 16 08:14:02.696578 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 567/1080] 10.222.0.59 () {60 vars in 1280 bytes} [Fri Sep 16 08:14:02 2022] DELETE /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 0 bytes in 252 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 08:14:02.705332 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-101833ae-cd63-4a48-be82-cb513cd3bfae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:02.706552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-101833ae-cd63-4a48-be82-cb513cd3bfae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:02.713452 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-101833ae-cd63-4a48-be82-cb513cd3bfae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:02.714183 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-101833ae-cd63-4a48-be82-cb513cd3bfae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:02.714625 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-101833ae-cd63-4a48-be82-cb513cd3bfae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:02.715373 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-101833ae-cd63-4a48-be82-cb513cd3bfae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:02.715826 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-101833ae-cd63-4a48-be82-cb513cd3bfae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:02.716661 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-101833ae-cd63-4a48-be82-cb513cd3bfae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:02.856013 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-101833ae-cd63-4a48-be82-cb513cd3bfae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:02.864775 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-101833ae-cd63-4a48-be82-cb513cd3bfae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:02.866272 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-101833ae-cd63-4a48-be82-cb513cd3bfae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:02.867473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-101833ae-cd63-4a48-be82-cb513cd3bfae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.166421 Sep 16 08:14:02.868047 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 514/1081] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:02 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 168 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:14:03.266201 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:03.267256 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:03.273424 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:03.273914 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:03.274353 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:03.275077 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:03.275534 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:03.276052 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:03.306942 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:03.307426 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:03.307864 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:03.308343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lazy-loading 'fault' on Instance uuid 8e9494f9-9706-4af0-b4ef-dac0291aae29 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:14:03.355876 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:03.363655 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5e1dd96c-8004-45dc-b829-fd9bbc4bbaf7 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1309 microversion: 2.1 time: 0.102426 Sep 16 08:14:03.364211 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 568/1082] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:03 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1309 bytes in 104 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:03.893135 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-90b9c71a-d1d5-4c8d-bf7d-f97cb914eb45 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:03.893765 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-90b9c71a-d1d5-4c8d-bf7d-f97cb914eb45 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:03.900290 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-90b9c71a-d1d5-4c8d-bf7d-f97cb914eb45 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:03.900774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-90b9c71a-d1d5-4c8d-bf7d-f97cb914eb45 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:03.901213 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-90b9c71a-d1d5-4c8d-bf7d-f97cb914eb45 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:03.901907 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-90b9c71a-d1d5-4c8d-bf7d-f97cb914eb45 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:03.902621 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-90b9c71a-d1d5-4c8d-bf7d-f97cb914eb45 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:03.903072 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-90b9c71a-d1d5-4c8d-bf7d-f97cb914eb45 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:04.030629 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-90b9c71a-d1d5-4c8d-bf7d-f97cb914eb45 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:04.038691 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-90b9c71a-d1d5-4c8d-bf7d-f97cb914eb45 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:04.040140 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-90b9c71a-d1d5-4c8d-bf7d-f97cb914eb45 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:04.041302 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-90b9c71a-d1d5-4c8d-bf7d-f97cb914eb45 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.153016 Sep 16 08:14:04.041917 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 515/1083] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:03 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:14:04.385500 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:04.386149 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:04.392653 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:04.393148 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:04.393595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:04.394299 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:04.394792 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:04.395232 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:04.426271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:04.426799 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:04.427248 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:04.427711 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lazy-loading 'fault' on Instance uuid 8e9494f9-9706-4af0-b4ef-dac0291aae29 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:14:04.467871 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:04.475640 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-d2c1e5e9-3252-47f8-846d-3c9f7622df60 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1309 microversion: 2.1 time: 0.094099 Sep 16 08:14:04.476191 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 569/1084] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:04 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:05.066433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a7f5bbcb-0ed8-4263-aeac-a75ba14405f3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:05.067000 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a7f5bbcb-0ed8-4263-aeac-a75ba14405f3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:05.073256 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a7f5bbcb-0ed8-4263-aeac-a75ba14405f3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:05.073749 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a7f5bbcb-0ed8-4263-aeac-a75ba14405f3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:05.074194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a7f5bbcb-0ed8-4263-aeac-a75ba14405f3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:05.075002 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a7f5bbcb-0ed8-4263-aeac-a75ba14405f3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:05.075472 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a7f5bbcb-0ed8-4263-aeac-a75ba14405f3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:05.076395 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a7f5bbcb-0ed8-4263-aeac-a75ba14405f3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:05.204383 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a7f5bbcb-0ed8-4263-aeac-a75ba14405f3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:05.212552 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a7f5bbcb-0ed8-4263-aeac-a75ba14405f3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:05.214006 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a7f5bbcb-0ed8-4263-aeac-a75ba14405f3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:05.215209 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a7f5bbcb-0ed8-4263-aeac-a75ba14405f3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.152807 Sep 16 08:14:05.215777 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 516/1085] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:05 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 360 bytes (2 switches on core 0) Sep 16 08:14:05.499559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:05.500178 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:05.506698 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:05.507209 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:05.507654 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:05.508385 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:05.508852 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:05.509287 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:05.539035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:05.539521 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:05.539962 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:05.540414 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lazy-loading 'fault' on Instance uuid 8e9494f9-9706-4af0-b4ef-dac0291aae29 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:14:05.580930 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:05.588542 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3e7c25a1-18b3-41c6-a25e-7c3dc2063ef6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1309 microversion: 2.1 time: 0.093569 Sep 16 08:14:05.589102 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 570/1086] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:05 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1309 bytes in 95 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:06.241464 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f0e49c29-518c-4542-8212-4304ebc152df tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:06.242123 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f0e49c29-518c-4542-8212-4304ebc152df tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:06.248695 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0e49c29-518c-4542-8212-4304ebc152df tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:06.249182 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0e49c29-518c-4542-8212-4304ebc152df tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:06.249624 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0e49c29-518c-4542-8212-4304ebc152df tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:06.250322 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0e49c29-518c-4542-8212-4304ebc152df tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:06.250807 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0e49c29-518c-4542-8212-4304ebc152df tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:06.251239 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f0e49c29-518c-4542-8212-4304ebc152df tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:06.376193 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f0e49c29-518c-4542-8212-4304ebc152df tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:06.384233 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f0e49c29-518c-4542-8212-4304ebc152df tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:06.385685 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-f0e49c29-518c-4542-8212-4304ebc152df tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:06.393299 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f0e49c29-518c-4542-8212-4304ebc152df tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.149363 Sep 16 08:14:06.393299 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 517/1087] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:06 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:14:06.611564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:06.612181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:06.618600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:06.623132 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:06.623132 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:06.623132 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:06.623132 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:06.623673 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:06.653060 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:06.653551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:06.653988 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:06.654442 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lazy-loading 'fault' on Instance uuid 8e9494f9-9706-4af0-b4ef-dac0291aae29 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:14:06.695239 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:06.703954 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8a942ed8-3c3d-4cd2-8a50-07ac3a4fbe16 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 200 len: 1309 microversion: 2.1 time: 0.096395 Sep 16 08:14:06.706723 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 571/1088] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:06 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 1309 bytes in 98 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:07.413445 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7ac63bf3-2d38-49cf-b5b6-470876f83079 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:07.414762 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7ac63bf3-2d38-49cf-b5b6-470876f83079 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:07.421793 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ac63bf3-2d38-49cf-b5b6-470876f83079 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:07.422284 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ac63bf3-2d38-49cf-b5b6-470876f83079 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:07.422755 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ac63bf3-2d38-49cf-b5b6-470876f83079 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:07.423465 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ac63bf3-2d38-49cf-b5b6-470876f83079 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:07.423926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ac63bf3-2d38-49cf-b5b6-470876f83079 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:07.424506 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7ac63bf3-2d38-49cf-b5b6-470876f83079 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:07.571202 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7ac63bf3-2d38-49cf-b5b6-470876f83079 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:07.581386 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7ac63bf3-2d38-49cf-b5b6-470876f83079 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:07.583098 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7ac63bf3-2d38-49cf-b5b6-470876f83079 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:07.584584 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7ac63bf3-2d38-49cf-b5b6-470876f83079 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1724 microversion: 2.20 time: 0.174875 Sep 16 08:14:07.598702 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 518/1089] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:07 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1724 bytes in 177 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:14:07.727272 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5ef7f6bb-44c4-406e-a522-8b4716fa947f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:07.728035 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5ef7f6bb-44c4-406e-a522-8b4716fa947f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: 8e9494f9-9706-4af0-b4ef-dac0291aae29] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:07.734718 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5ef7f6bb-44c4-406e-a522-8b4716fa947f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:07.738892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5ef7f6bb-44c4-406e-a522-8b4716fa947f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:07.738892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5ef7f6bb-44c4-406e-a522-8b4716fa947f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:07.738892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5ef7f6bb-44c4-406e-a522-8b4716fa947f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:07.738892 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5ef7f6bb-44c4-406e-a522-8b4716fa947f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:07.739252 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5ef7f6bb-44c4-406e-a522-8b4716fa947f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:07.753139 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-5ef7f6bb-44c4-406e-a522-8b4716fa947f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] HTTP exception thrown: Instance 8e9494f9-9706-4af0-b4ef-dac0291aae29 could not be found. Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5ef7f6bb-44c4-406e-a522-8b4716fa947f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Request method failure captured: Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 HTTP/1.1 Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC_5afi8-AKk4W59S3MhGtR46yNvq8Mn6Hp0d2E2d4Jx0UAfr7D3vp3oWvOrFVycakj9kkRfNyTuK_sS3o0YrVSIN7Bi-x5TM9CNT4A1pYEHkTxQ9tRqEZ2xjZkXJ3PIi-YyElPqgqX-p-KpSG1WJSbrrXOBHAw9TEC_ojGYqpxUyH0 Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: e3276981b48d4974841dd97ee1cb9882 Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1366856393 Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:14:07.754931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:14:07.756660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3276981b48d4974841dd97ee1cb9882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3276981b48d4974841dd97ee1cb9882"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3276981b48d4974841dd97ee1cb9882", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3276981b48d4974841dd97ee1cb9882"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:14:07.756660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-VolumesSnapshotTestJSON-1366856393 Sep 16 08:14:07.756660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: e3276981b48d4974841dd97ee1cb9882 Sep 16 08:14:07.756660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1366856393 Sep 16 08:14:07.756660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-VolumesSnapshotTestJSON-1366856393-project Sep 16 08:14:07.756660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:14:07.756660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:14:07.756660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: cc14169c8f7044c6815944af5bc658a9 Sep 16 08:14:07.756660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-VolumesSnapshotTestJSON-1366856393-project Sep 16 08:14:07.756660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:14:07.756660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 8e9494f9-9706-4af0-b4ef-dac0291aae29 could not be found. Sep 16 08:14:07.756660 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '8e9494f9-9706-4af0-b4ef-dac0291aae29'} Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 8e9494f9-9706-4af0-b4ef-dac0291aae29 could not be found. Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:14:07.757670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 8e9494f9-9706-4af0-b4ef-dac0291aae29 could not be found. Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 8e9494f9-9706-4af0-b4ef-dac0291aae29 could not be found. Sep 16 08:14:07.759300 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:07.761450 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5ef7f6bb-44c4-406e-a522-8b4716fa947f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Returning 404 to user: Instance 8e9494f9-9706-4af0-b4ef-dac0291aae29 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:14:07.762416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5ef7f6bb-44c4-406e-a522-8b4716fa947f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29" status: 404 len: 111 microversion: 2.1 time: 0.039247 Sep 16 08:14:07.763501 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 572/1090] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:07 2022] GET /compute/v2.1/servers/8e9494f9-9706-4af0-b4ef-dac0291aae29 => generated 111 bytes in 41 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:14:08.229263 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-dcc8ef86-cfe8-4f97-84f6-0e1f315b183c req-e0ec9a9d-e59f-4540-92d3-e1b638e2e996 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "7f6b33b5-7327-4c2f-ae74-6f718e860360", "name": "network-vif-deleted", "tag": "24fc5230-45b4-476e-ae08-dc736c4339d1"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:14:08.239257 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-dcc8ef86-cfe8-4f97-84f6-0e1f315b183c req-e0ec9a9d-e59f-4540-92d3-e1b638e2e996 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:08.239743 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-dcc8ef86-cfe8-4f97-84f6-0e1f315b183c req-e0ec9a9d-e59f-4540-92d3-e1b638e2e996 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:08.240210 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-dcc8ef86-cfe8-4f97-84f6-0e1f315b183c req-e0ec9a9d-e59f-4540-92d3-e1b638e2e996 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:08.252628 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-dcc8ef86-cfe8-4f97-84f6-0e1f315b183c req-e0ec9a9d-e59f-4540-92d3-e1b638e2e996 service nova] Creating event network-vif-deleted:24fc5230-45b4-476e-ae08-dc736c4339d1 for instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 on hv-cinder-74014 Sep 16 08:14:08.257773 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-dcc8ef86-cfe8-4f97-84f6-0e1f315b183c req-e0ec9a9d-e59f-4540-92d3-e1b638e2e996 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032151 Sep 16 08:14:08.258785 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 519/1091] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:14:08 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:14:08.611810 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b82d613e-041b-4109-b10a-ddf200933383 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:08.612327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b82d613e-041b-4109-b10a-ddf200933383 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:08.618482 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b82d613e-041b-4109-b10a-ddf200933383 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:08.619004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b82d613e-041b-4109-b10a-ddf200933383 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:08.619453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b82d613e-041b-4109-b10a-ddf200933383 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:08.620160 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b82d613e-041b-4109-b10a-ddf200933383 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:08.620617 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b82d613e-041b-4109-b10a-ddf200933383 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:08.621049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b82d613e-041b-4109-b10a-ddf200933383 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:08.686932 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b82d613e-041b-4109-b10a-ddf200933383 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:08.694890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b82d613e-041b-4109-b10a-ddf200933383 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:08.696355 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-b82d613e-041b-4109-b10a-ddf200933383 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:08.697530 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b82d613e-041b-4109-b10a-ddf200933383 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1657 microversion: 2.20 time: 0.089769 Sep 16 08:14:08.698070 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 573/1092] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:08 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1657 bytes in 91 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:14:09.724311 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d9b4abbd-6414-4e47-be9e-ce1bf558a02b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:09.725019 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d9b4abbd-6414-4e47-be9e-ce1bf558a02b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:09.731261 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9b4abbd-6414-4e47-be9e-ce1bf558a02b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:09.732415 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9b4abbd-6414-4e47-be9e-ce1bf558a02b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:09.732859 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9b4abbd-6414-4e47-be9e-ce1bf558a02b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:09.733559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9b4abbd-6414-4e47-be9e-ce1bf558a02b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:09.734019 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9b4abbd-6414-4e47-be9e-ce1bf558a02b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:09.734452 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d9b4abbd-6414-4e47-be9e-ce1bf558a02b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:09.796683 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d9b4abbd-6414-4e47-be9e-ce1bf558a02b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:09.804718 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d9b4abbd-6414-4e47-be9e-ce1bf558a02b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:09.806180 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d9b4abbd-6414-4e47-be9e-ce1bf558a02b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:09.807384 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d9b4abbd-6414-4e47-be9e-ce1bf558a02b tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1657 microversion: 2.20 time: 0.087909 Sep 16 08:14:09.807948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 520/1093] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:09 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1657 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:14:10.832818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4cb1f043-90d1-460d-93c0-063004a6752a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:10.833365 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4cb1f043-90d1-460d-93c0-063004a6752a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:10.839600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4cb1f043-90d1-460d-93c0-063004a6752a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:10.840088 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4cb1f043-90d1-460d-93c0-063004a6752a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:10.840530 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4cb1f043-90d1-460d-93c0-063004a6752a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:10.841223 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4cb1f043-90d1-460d-93c0-063004a6752a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:10.841684 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4cb1f043-90d1-460d-93c0-063004a6752a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:10.842114 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4cb1f043-90d1-460d-93c0-063004a6752a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:10.905847 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4cb1f043-90d1-460d-93c0-063004a6752a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:10.913966 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4cb1f043-90d1-460d-93c0-063004a6752a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:10.916883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4cb1f043-90d1-460d-93c0-063004a6752a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:10.916883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4cb1f043-90d1-460d-93c0-063004a6752a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1657 microversion: 2.20 time: 0.087806 Sep 16 08:14:10.917156 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 574/1094] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:10 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1657 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:14:11.942158 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:11.942798 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:11.949064 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:11.949559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:11.950000 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:11.950733 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:11.951802 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:11.952241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:11.982635 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:11.983150 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:11.983578 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:11.984027 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lazy-loading 'fault' on Instance uuid 7f6b33b5-7327-4c2f-ae74-6f718e860360 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:14:12.026998 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:12.035927 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:12.037309 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:12.038491 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b88ac2d2-144d-4235-aef4-5b9fd803d9a5 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1372 microversion: 2.20 time: 0.100260 Sep 16 08:14:12.039087 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 521/1095] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:11 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1372 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:14:13.069551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:13.070133 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:13.077095 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:13.077578 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:13.078016 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:13.078763 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:13.079416 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:13.081091 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:13.111271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:13.111745 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:13.112181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:13.112626 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lazy-loading 'fault' on Instance uuid 7f6b33b5-7327-4c2f-ae74-6f718e860360 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:14:13.152554 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:13.161226 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:13.162698 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:13.163975 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4c21f5ef-2225-4814-85aa-4037cf20702a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1372 microversion: 2.20 time: 0.098365 Sep 16 08:14:13.164616 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 575/1096] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:13 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1372 bytes in 100 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:14:14.187974 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:14.192349 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:14.195310 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:14.195772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:14.196217 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:14.196916 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:14.197377 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:14.197845 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:14.230907 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:14.231384 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:14.231825 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:14.232958 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lazy-loading 'fault' on Instance uuid 7f6b33b5-7327-4c2f-ae74-6f718e860360 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:14:14.272663 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:14.275033 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:14:14.282238 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:14.283734 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Policy check for os_compute_api:servers:show:host_status:unknown-only failed with credentials {'is_admin': False, 'user_id': '81e89f8fb70d49d18cd0c81c98dd4add', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '8191457181714862bbeb70259fa86971', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:14.284881 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0031c6dd-9467-4dc0-8fe3-f8359ecdf076 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 200 len: 1372 microversion: 2.20 time: 0.100877 Sep 16 08:14:14.285443 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 522/1097] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:14 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 1372 bytes in 102 msecs (HTTP/1.1 200) 9 headers in 360 bytes (1 switches on core 0) Sep 16 08:14:15.313656 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-38af17e4-5073-4c87-8adf-f2959466e455 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:15.314260 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-38af17e4-5073-4c87-8adf-f2959466e455 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:15.320883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-38af17e4-5073-4c87-8adf-f2959466e455 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:15.321366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-38af17e4-5073-4c87-8adf-f2959466e455 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:15.321867 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-38af17e4-5073-4c87-8adf-f2959466e455 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:15.322559 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-38af17e4-5073-4c87-8adf-f2959466e455 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:15.323044 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-38af17e4-5073-4c87-8adf-f2959466e455 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:15.323466 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-38af17e4-5073-4c87-8adf-f2959466e455 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:15.336828 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-38af17e4-5073-4c87-8adf-f2959466e455 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] HTTP exception thrown: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-38af17e4-5073-4c87-8adf-f2959466e455 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Request method failure captured: Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 HTTP/1.1 Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC6irA81AAf42vHmJutRQNC5aIfjl28CScTLRSYiVLMIrEjHIRUJoW_TDTAPgb3885lU7_saUm9szGSmcBJMD4OpUOsfh0qr9JW64prMC6IJLX8ne5HWwv1CdZ8_88uBPEk8juWCp-JYXJiYX9UvyQ1E3azOFoHGQU3NEBRQcRWJuec Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 8191457181714862bbeb70259fa86971 Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:14:15.338389 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:14:15.340225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8191457181714862bbeb70259fa86971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8191457181714862bbeb70259fa86971"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8191457181714862bbeb70259fa86971", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8191457181714862bbeb70259fa86971"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:14:15.340225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:15.340225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 8191457181714862bbeb70259fa86971 Sep 16 08:14:15.340225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:15.340225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-AttachVolumeShelveTestJSON-665464524-project Sep 16 08:14:15.340225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:14:15.340225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:14:15.340225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: 81e89f8fb70d49d18cd0c81c98dd4add Sep 16 08:14:15.340225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-AttachVolumeShelveTestJSON-665464524-project Sep 16 08:14:15.340225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:14:15.340225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:15.340225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '7f6b33b5-7327-4c2f-ae74-6f718e860360'} Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:14:15.341288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:15.342865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:15.344364 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-38af17e4-5073-4c87-8adf-f2959466e455 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Returning 404 to user: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:14:15.344364 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-38af17e4-5073-4c87-8adf-f2959466e455 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 404 len: 111 microversion: 2.20 time: 0.030782 Sep 16 08:14:15.344364 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 576/1098] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:15 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 08:14:15.349005 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-8527aaf4-c2fd-4c4e-bdf7-cd87aaf4a1f6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '.version_select at 0x7f9d06e71ee0>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:15.451812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-8527aaf4-c2fd-4c4e-bdf7-cd87aaf4a1f6 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-keypair-1972670979" status: 204 len: 0 microversion: 2.20 time: 0.106616 Sep 16 08:14:15.453635 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 523/1099] 10.222.0.59 () {60 vars in 1262 bytes} [Fri Sep 16 08:14:15 2022] DELETE /compute/v2.1/os-keypairs/tempest-keypair-1972670979 => generated 0 bytes in 108 msecs (HTTP/1.1 204) 9 headers in 365 bytes (1 switches on core 0) Sep 16 08:14:17.463875 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-56787b06-c5ca-457d-8324-c7bcb6206055 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:17.464469 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-56787b06-c5ca-457d-8324-c7bcb6206055 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:17.471680 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56787b06-c5ca-457d-8324-c7bcb6206055 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:17.472176 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56787b06-c5ca-457d-8324-c7bcb6206055 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:17.472625 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56787b06-c5ca-457d-8324-c7bcb6206055 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:17.473327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56787b06-c5ca-457d-8324-c7bcb6206055 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:17.473794 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56787b06-c5ca-457d-8324-c7bcb6206055 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:17.474226 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-56787b06-c5ca-457d-8324-c7bcb6206055 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:17.487453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-56787b06-c5ca-457d-8324-c7bcb6206055 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] HTTP exception thrown: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-56787b06-c5ca-457d-8324-c7bcb6206055 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Request method failure captured: Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: DELETE /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 HTTP/1.1 Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC6irA81AAf42vHmJutRQNC5aIfjl28CScTLRSYiVLMIrEjHIRUJoW_TDTAPgb3885lU7_saUm9szGSmcBJMD4OpUOsfh0qr9JW64prMC6IJLX8ne5HWwv1CdZ8_88uBPEk8juWCp-JYXJiYX9UvyQ1E3azOFoHGQU3NEBRQcRWJuec Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 8191457181714862bbeb70259fa86971 Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:14:17.492907 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:14:17.494632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8191457181714862bbeb70259fa86971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8191457181714862bbeb70259fa86971"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8191457181714862bbeb70259fa86971", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8191457181714862bbeb70259fa86971"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:14:17.494632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:17.494632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 8191457181714862bbeb70259fa86971 Sep 16 08:14:17.494632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:17.494632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-AttachVolumeShelveTestJSON-665464524-project Sep 16 08:14:17.494632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:14:17.494632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:14:17.494632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: 81e89f8fb70d49d18cd0c81c98dd4add Sep 16 08:14:17.494632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-AttachVolumeShelveTestJSON-665464524-project Sep 16 08:14:17.494632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:14:17.494632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:17.494632 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '7f6b33b5-7327-4c2f-ae74-6f718e860360'} Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:14:17.495576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:17.496860 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:17.498161 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-56787b06-c5ca-457d-8324-c7bcb6206055 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Returning 404 to user: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:14:17.498161 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-56787b06-c5ca-457d-8324-c7bcb6206055 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 404 len: 111 microversion: 2.20 time: 0.030340 Sep 16 08:14:17.498161 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 577/1100] 10.222.0.59 () {60 vars in 1280 bytes} [Fri Sep 16 08:14:17 2022] DELETE /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 08:14:17.500543 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f6f86a72-4080-4c50-9565-abfe13bc50ae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:17.501164 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-f6f86a72-4080-4c50-9565-abfe13bc50ae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7f6b33b5-7327-4c2f-ae74-6f718e860360] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:17.508308 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f6f86a72-4080-4c50-9565-abfe13bc50ae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:17.508802 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f6f86a72-4080-4c50-9565-abfe13bc50ae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:17.509247 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f6f86a72-4080-4c50-9565-abfe13bc50ae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:17.510016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f6f86a72-4080-4c50-9565-abfe13bc50ae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:17.510478 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f6f86a72-4080-4c50-9565-abfe13bc50ae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:17.510951 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-f6f86a72-4080-4c50-9565-abfe13bc50ae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:17.524843 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-f6f86a72-4080-4c50-9565-abfe13bc50ae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] HTTP exception thrown: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f6f86a72-4080-4c50-9565-abfe13bc50ae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Request method failure captured: Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 HTTP/1.1 Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC6irA81AAf42vHmJutRQNC5aIfjl28CScTLRSYiVLMIrEjHIRUJoW_TDTAPgb3885lU7_saUm9szGSmcBJMD4OpUOsfh0qr9JW64prMC6IJLX8ne5HWwv1CdZ8_88uBPEk8juWCp-JYXJiYX9UvyQ1E3azOFoHGQU3NEBRQcRWJuec Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 8191457181714862bbeb70259fa86971 Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:14:17.526505 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:14:17.528523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8191457181714862bbeb70259fa86971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8191457181714862bbeb70259fa86971"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8191457181714862bbeb70259fa86971", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8191457181714862bbeb70259fa86971"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:14:17.528523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:17.528523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 8191457181714862bbeb70259fa86971 Sep 16 08:14:17.528523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:17.528523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeShelveTestJSON-665464524-project Sep 16 08:14:17.528523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:14:17.528523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:14:17.528523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: 81e89f8fb70d49d18cd0c81c98dd4add Sep 16 08:14:17.528523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeShelveTestJSON-665464524-project Sep 16 08:14:17.528523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:14:17.528523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:17.528523 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '7f6b33b5-7327-4c2f-ae74-6f718e860360'} Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:14:17.530358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. Sep 16 08:14:17.531985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:17.533468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-f6f86a72-4080-4c50-9565-abfe13bc50ae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Returning 404 to user: Instance 7f6b33b5-7327-4c2f-ae74-6f718e860360 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:14:17.533468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-f6f86a72-4080-4c50-9565-abfe13bc50ae tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360" status: 404 len: 111 microversion: 2.20 time: 0.032491 Sep 16 08:14:17.533468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 524/1101] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:17 2022] GET /compute/v2.1/servers/7f6b33b5-7327-4c2f-ae74-6f718e860360 => generated 111 bytes in 34 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 08:14:21.395635 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesSnapshotTestJSON-instance-789468663", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452", "networks": [{"uuid": "bc4f5dfd-e75f-417b-a277-edb3999f1a95"}]}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:14:21.449025 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.network.neutron [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] validate_networks() for [('bc4f5dfd-e75f-417b-a277-edb3999f1a95', None, None, None, None, None)] {{(pid=121046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:14:21.795913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Flavor limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:14:21.796336 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Image limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:14:21.796812 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Flavor pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:14:21.797221 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Image pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:14:21.797633 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:14:21.806992 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:21.807476 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:21.807924 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:21.808634 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:21.809085 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:21.809596 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:21.825736 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Getting quotas for project e3276981b48d4974841dd97ee1cb9882. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:14:21.829546 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Getting quotas for user cc14169c8f7044c6815944af5bc658a9 and project e3276981b48d4974841dd97ee1cb9882. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:14:21.840177 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Going to run 1 instances... {{(pid=121046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:14:21.843062 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:14:21.953306 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9f2ebb20-57d9-4956-9063-70b06b258d3a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:21.953847 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9f2ebb20-57d9-4956-9063-70b06b258d3a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:21.960710 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9f2ebb20-57d9-4956-9063-70b06b258d3a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:21.961198 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9f2ebb20-57d9-4956-9063-70b06b258d3a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:21.961691 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9f2ebb20-57d9-4956-9063-70b06b258d3a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:21.962394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9f2ebb20-57d9-4956-9063-70b06b258d3a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:21.962893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9f2ebb20-57d9-4956-9063-70b06b258d3a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:21.963330 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9f2ebb20-57d9-4956-9063-70b06b258d3a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:21.966320 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-59066f59-5a32-49bd-8717-e053513b2fad tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.574518 Sep 16 08:14:21.973975 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 578/1102] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:14:21 2022] POST /compute/v2.1/servers => generated 380 bytes in 577 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:14:21.979256 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-11715bc7-9a62-48ef-8471-82e867281a4c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:21.979615 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-9f2ebb20-57d9-4956-9063-70b06b258d3a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] HTTP exception thrown: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:14:21.979925 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-11715bc7-9a62-48ef-8471-82e867281a4c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9f2ebb20-57d9-4956-9063-70b06b258d3a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Request method failure captured: Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: DELETE /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c HTTP/1.1 Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC6irA81AAf42vHmJutRQNC5aIfjl28CScTLRSYiVLMIrEjHIRUJoW_TDTAPgb3885lU7_saUm9szGSmcBJMD4OpUOsfh0qr9JW64prMC6IJLX8ne5HWwv1CdZ8_88uBPEk8juWCp-JYXJiYX9UvyQ1E3azOFoHGQU3NEBRQcRWJuec Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 8191457181714862bbeb70259fa86971 Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:14:21.981207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:14:21.982948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8191457181714862bbeb70259fa86971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8191457181714862bbeb70259fa86971"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8191457181714862bbeb70259fa86971", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8191457181714862bbeb70259fa86971"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:14:21.982948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:21.982948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 8191457181714862bbeb70259fa86971 Sep 16 08:14:21.982948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:21.982948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeShelveTestJSON-665464524-project Sep 16 08:14:21.982948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:14:21.982948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:14:21.982948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: 81e89f8fb70d49d18cd0c81c98dd4add Sep 16 08:14:21.982948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeShelveTestJSON-665464524-project Sep 16 08:14:21.982948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:14:21.982948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:14:21.982948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c'} Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:14:21.983782 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:14:21.985892 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:21.987932 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9f2ebb20-57d9-4956-9063-70b06b258d3a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Returning 404 to user: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:14:21.987932 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9f2ebb20-57d9-4956-9063-70b06b258d3a tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "DELETE /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 404 len: 111 microversion: 2.20 time: 0.034865 Sep 16 08:14:21.987932 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 525/1103] 10.222.0.59 () {60 vars in 1280 bytes} [Fri Sep 16 08:14:21 2022] DELETE /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 111 bytes in 36 msecs (HTTP/1.1 404) 9 headers in 381 bytes (2 switches on core 0) Sep 16 08:14:21.993945 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1d36f089-c63e-4e3e-ab6c-64978e49a3a3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:21.994756 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-1d36f089-c63e-4e3e-ab6c-64978e49a3a3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] [instance: 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:22.000930 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1d36f089-c63e-4e3e-ab6c-64978e49a3a3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:22.001669 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1d36f089-c63e-4e3e-ab6c-64978e49a3a3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:22.002323 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1d36f089-c63e-4e3e-ab6c-64978e49a3a3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:22.003259 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1d36f089-c63e-4e3e-ab6c-64978e49a3a3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:22.003638 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1d36f089-c63e-4e3e-ab6c-64978e49a3a3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:22.004074 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-1d36f089-c63e-4e3e-ab6c-64978e49a3a3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:22.019248 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-1d36f089-c63e-4e3e-ab6c-64978e49a3a3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] HTTP exception thrown: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1d36f089-c63e-4e3e-ab6c-64978e49a3a3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Request method failure captured: Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c HTTP/1.1 Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC6irA81AAf42vHmJutRQNC5aIfjl28CScTLRSYiVLMIrEjHIRUJoW_TDTAPgb3885lU7_saUm9szGSmcBJMD4OpUOsfh0qr9JW64prMC6IJLX8ne5HWwv1CdZ8_88uBPEk8juWCp-JYXJiYX9UvyQ1E3azOFoHGQU3NEBRQcRWJuec Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Openstack-Nova-Api-Version: 2.20 Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 8191457181714862bbeb70259fa86971 Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:14:22.021354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:14:22.022888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8191457181714862bbeb70259fa86971"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/8191457181714862bbeb70259fa86971"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_8191457181714862bbeb70259fa86971", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/8191457181714862bbeb70259fa86971"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:14:22.022888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:22.022888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 8191457181714862bbeb70259fa86971 Sep 16 08:14:22.022888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-AttachVolumeShelveTestJSON-665464524 Sep 16 08:14:22.022888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-AttachVolumeShelveTestJSON-665464524-project Sep 16 08:14:22.022888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:14:22.022888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:14:22.022888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: 81e89f8fb70d49d18cd0c81c98dd4add Sep 16 08:14:22.022888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-AttachVolumeShelveTestJSON-665464524-project Sep 16 08:14:22.022888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:14:22.022888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:14:22.022888 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': '7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c'} Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:14:22.023817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. Sep 16 08:14:22.025477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:22.027472 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-1d36f089-c63e-4e3e-ab6c-64978e49a3a3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] Returning 404 to user: Instance 7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:14:22.027472 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-1d36f089-c63e-4e3e-ab6c-64978e49a3a3 tempest-AttachVolumeShelveTestJSON-665464524 tempest-AttachVolumeShelveTestJSON-665464524-project] 10.222.0.59 "GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c" status: 404 len: 111 microversion: 2.20 time: 0.032691 Sep 16 08:14:22.027472 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 526/1104] 10.222.0.59 () {60 vars in 1277 bytes} [Fri Sep 16 08:14:21 2022] GET /compute/v2.1/servers/7eb06ee3-8a8b-4c8a-b8ce-324ba9ec722c => generated 111 bytes in 35 msecs (HTTP/1.1 404) 9 headers in 381 bytes (1 switches on core 0) Sep 16 08:14:22.075284 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-11715bc7-9a62-48ef-8471-82e867281a4c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:22.084861 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-11715bc7-9a62-48ef-8471-82e867281a4c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1218 microversion: 2.1 time: 0.109345 Sep 16 08:14:22.085430 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 579/1105] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:21 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1218 bytes in 111 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:14:23.108094 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-825236bc-05a7-4a64-abdf-be8dc40ed49c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:23.108816 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-825236bc-05a7-4a64-abdf-be8dc40ed49c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:23.115926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-825236bc-05a7-4a64-abdf-be8dc40ed49c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:23.116548 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-825236bc-05a7-4a64-abdf-be8dc40ed49c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:23.116987 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-825236bc-05a7-4a64-abdf-be8dc40ed49c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:23.117693 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-825236bc-05a7-4a64-abdf-be8dc40ed49c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:23.118145 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-825236bc-05a7-4a64-abdf-be8dc40ed49c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:23.118568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-825236bc-05a7-4a64-abdf-be8dc40ed49c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:23.183207 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-825236bc-05a7-4a64-abdf-be8dc40ed49c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:23.192322 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-825236bc-05a7-4a64-abdf-be8dc40ed49c tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1222 microversion: 2.1 time: 0.088376 Sep 16 08:14:23.192943 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 527/1106] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:23 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1222 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:24.216114 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-68d5c6ac-7eb3-412f-b347-85e35578c825 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:24.218056 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-68d5c6ac-7eb3-412f-b347-85e35578c825 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:24.225246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68d5c6ac-7eb3-412f-b347-85e35578c825 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:24.226169 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68d5c6ac-7eb3-412f-b347-85e35578c825 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:24.226895 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68d5c6ac-7eb3-412f-b347-85e35578c825 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:24.227859 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68d5c6ac-7eb3-412f-b347-85e35578c825 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:24.228581 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68d5c6ac-7eb3-412f-b347-85e35578c825 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:24.229246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-68d5c6ac-7eb3-412f-b347-85e35578c825 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:24.402814 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-68d5c6ac-7eb3-412f-b347-85e35578c825 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:24.408327 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-68d5c6ac-7eb3-412f-b347-85e35578c825 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1278 microversion: 2.1 time: 0.196103 Sep 16 08:14:24.409456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 580/1107] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:24 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1278 bytes in 198 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:25.441472 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7e363af6-acd9-4124-b2b8-18a47b747fc4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:25.441472 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7e363af6-acd9-4124-b2b8-18a47b747fc4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:25.459909 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7e363af6-acd9-4124-b2b8-18a47b747fc4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:25.460350 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7e363af6-acd9-4124-b2b8-18a47b747fc4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:25.460800 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7e363af6-acd9-4124-b2b8-18a47b747fc4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:25.461575 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7e363af6-acd9-4124-b2b8-18a47b747fc4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:25.462036 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7e363af6-acd9-4124-b2b8-18a47b747fc4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:25.465402 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7e363af6-acd9-4124-b2b8-18a47b747fc4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:25.578159 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7e363af6-acd9-4124-b2b8-18a47b747fc4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:25.592682 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7e363af6-acd9-4124-b2b8-18a47b747fc4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1276 microversion: 2.1 time: 0.161104 Sep 16 08:14:25.599292 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 528/1108] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:25 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1276 bytes in 167 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:26.617454 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dfb3943c-208a-4fdf-9830-05a1b58c3ba4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:26.618173 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dfb3943c-208a-4fdf-9830-05a1b58c3ba4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:26.620917 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=72,nova_api:UPDATE=1,nova_api:INSERT=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:14:26.627020 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dfb3943c-208a-4fdf-9830-05a1b58c3ba4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:26.635186 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dfb3943c-208a-4fdf-9830-05a1b58c3ba4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.007s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:26.636263 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dfb3943c-208a-4fdf-9830-05a1b58c3ba4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:26.637212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dfb3943c-208a-4fdf-9830-05a1b58c3ba4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:26.638147 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dfb3943c-208a-4fdf-9830-05a1b58c3ba4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:26.638783 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dfb3943c-208a-4fdf-9830-05a1b58c3ba4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:27.005700 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dfb3943c-208a-4fdf-9830-05a1b58c3ba4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:27.008025 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:14:27.015303 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dfb3943c-208a-4fdf-9830-05a1b58c3ba4 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1318 microversion: 2.1 time: 0.402152 Sep 16 08:14:27.016899 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 581/1109] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:26 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1318 bytes in 404 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:27.281725 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-03116f28-5c9e-4673-bb8a-1a9d0ebd03a8 req-274471f3-3d6f-4f05-88cc-40f876e48ba0 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "fe729404-cdb5-4165-9882-3f7595ae2ac7", "tag": "8e4aeef0-48be-4b7b-93b1-8e29262b781c"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:14:27.298553 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-03116f28-5c9e-4673-bb8a-1a9d0ebd03a8 req-274471f3-3d6f-4f05-88cc-40f876e48ba0 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:27.300631 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-03116f28-5c9e-4673-bb8a-1a9d0ebd03a8 req-274471f3-3d6f-4f05-88cc-40f876e48ba0 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:27.302178 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-03116f28-5c9e-4673-bb8a-1a9d0ebd03a8 req-274471f3-3d6f-4f05-88cc-40f876e48ba0 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:27.338128 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-03116f28-5c9e-4673-bb8a-1a9d0ebd03a8 req-274471f3-3d6f-4f05-88cc-40f876e48ba0 service nova] Creating event network-changed:8e4aeef0-48be-4b7b-93b1-8e29262b781c for instance fe729404-cdb5-4165-9882-3f7595ae2ac7 on hv-cinder-74014 Sep 16 08:14:27.345153 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-03116f28-5c9e-4673-bb8a-1a9d0ebd03a8 req-274471f3-3d6f-4f05-88cc-40f876e48ba0 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.070248 Sep 16 08:14:27.346404 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 529/1110] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:14:27 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 72 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:14:28.045474 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c948bb0f-5b46-4f05-b525-0a62c90a0743 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:28.046108 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c948bb0f-5b46-4f05-b525-0a62c90a0743 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:28.066633 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c948bb0f-5b46-4f05-b525-0a62c90a0743 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:28.067174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c948bb0f-5b46-4f05-b525-0a62c90a0743 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:28.067629 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c948bb0f-5b46-4f05-b525-0a62c90a0743 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:28.069202 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c948bb0f-5b46-4f05-b525-0a62c90a0743 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:28.081803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c948bb0f-5b46-4f05-b525-0a62c90a0743 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:28.082437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c948bb0f-5b46-4f05-b525-0a62c90a0743 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.013s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:28.297863 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c948bb0f-5b46-4f05-b525-0a62c90a0743 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:28.313452 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c948bb0f-5b46-4f05-b525-0a62c90a0743 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1318 microversion: 2.1 time: 0.275695 Sep 16 08:14:28.327703 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 582/1111] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:28 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1318 bytes in 290 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:29.343351 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-9da7110a-a476-4ddf-983c-967eed735c7f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:29.343351 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-9da7110a-a476-4ddf-983c-967eed735c7f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:29.350956 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9da7110a-a476-4ddf-983c-967eed735c7f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:29.351997 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9da7110a-a476-4ddf-983c-967eed735c7f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:29.352839 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9da7110a-a476-4ddf-983c-967eed735c7f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:29.353912 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9da7110a-a476-4ddf-983c-967eed735c7f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:29.354792 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9da7110a-a476-4ddf-983c-967eed735c7f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:29.355457 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-9da7110a-a476-4ddf-983c-967eed735c7f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:29.363721 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7f36d5de-d0c3-4d41-81ad-252dd3a2afe0 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Action: 'create', calling method: .version_select at 0x7f9d06d92310>, body: {"volume": {"size": 1, "display_name": "tempest-VolumesSnapshotsTestJSON-volume-246156764"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:14:29.602493 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-9da7110a-a476-4ddf-983c-967eed735c7f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:29.613206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-9da7110a-a476-4ddf-983c-967eed735c7f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1318 microversion: 2.1 time: 0.279404 Sep 16 08:14:29.627736 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 583/1112] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:29 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1318 bytes in 281 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:14:30.176015 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7f36d5de-d0c3-4d41-81ad-252dd3a2afe0 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "POST /compute/v2.1/os-volumes" status: 200 len: 344 microversion: 2.1 time: 1.012948 Sep 16 08:14:30.185113 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 530/1113] 10.222.0.59 () {60 vars in 1155 bytes} [Fri Sep 16 08:14:29 2022] POST /compute/v2.1/os-volumes => generated 344 bytes in 1023 msecs (HTTP/1.1 200) 10 headers in 448 bytes (1 switches on core 0) Sep 16 08:14:30.193048 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7b7bbe4c-62ae-44cb-b61a-083744e96152 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d06952e50>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:30.270104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7b7bbe4c-62ae-44cb-b61a-083744e96152 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda" status: 200 len: 344 microversion: 2.1 time: 0.083124 Sep 16 08:14:30.270702 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 584/1114] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:14:30 2022] GET /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda => generated 344 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:14:30.640906 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-4d89021c-67f0-463d-84f0-f94cf7d5a3f6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:30.641641 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-4d89021c-67f0-463d-84f0-f94cf7d5a3f6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:30.644189 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=43,nova_api:DELETE=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:14:30.649653 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d89021c-67f0-463d-84f0-f94cf7d5a3f6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:30.650169 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d89021c-67f0-463d-84f0-f94cf7d5a3f6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:30.650633 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d89021c-67f0-463d-84f0-f94cf7d5a3f6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:30.651427 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d89021c-67f0-463d-84f0-f94cf7d5a3f6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:30.652936 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d89021c-67f0-463d-84f0-f94cf7d5a3f6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:30.653500 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-4d89021c-67f0-463d-84f0-f94cf7d5a3f6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:30.809387 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-4d89021c-67f0-463d-84f0-f94cf7d5a3f6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:30.820408 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-4d89021c-67f0-463d-84f0-f94cf7d5a3f6 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1318 microversion: 2.1 time: 0.183900 Sep 16 08:14:30.821522 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 531/1115] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:30 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1318 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:31.284698 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-34c5f053-a1d6-426e-a93f-1276c3ac1924 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d06b414c0>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:31.342122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-34c5f053-a1d6-426e-a93f-1276c3ac1924 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda" status: 200 len: 345 microversion: 2.1 time: 0.061521 Sep 16 08:14:31.343448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 585/1116] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:14:31 2022] GET /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda => generated 345 bytes in 64 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:14:31.357484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-00af39f9-fad3-42b0-88fa-01df250de475 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Action: 'create', calling method: .version_select at 0x7f9d06d92ee0>, body: {"snapshot": {"volume_id": "e23c7046-84d1-4ad8-b564-a0717a79adda", "display_name": "tempest-VolumesSnapshotsTestJSON-Snapshot-549343710"}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:14:31.840831 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:14:31.846109 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5c8ced87-d79e-42e0-b72b-2e99095b9a31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:31.846771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5c8ced87-d79e-42e0-b72b-2e99095b9a31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:31.855999 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5c8ced87-d79e-42e0-b72b-2e99095b9a31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:31.856818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5c8ced87-d79e-42e0-b72b-2e99095b9a31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:31.857459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5c8ced87-d79e-42e0-b72b-2e99095b9a31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:31.859105 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5c8ced87-d79e-42e0-b72b-2e99095b9a31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:31.864948 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-00af39f9-fad3-42b0-88fa-01df250de475 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "POST /compute/v2.1/os-snapshots" status: 200 len: 286 microversion: 2.1 time: 0.512277 Sep 16 08:14:31.865830 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 532/1117] 10.222.0.59 () {60 vars in 1162 bytes} [Fri Sep 16 08:14:31 2022] POST /compute/v2.1/os-snapshots => generated 286 bytes in 514 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:14:31.872360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5c8ced87-d79e-42e0-b72b-2e99095b9a31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.012s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:31.872840 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5c8ced87-d79e-42e0-b72b-2e99095b9a31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:31.877001 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ed04f454-1b86-4789-9476-da6223cbb53c tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d0685f5e0>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:31.935007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ed04f454-1b86-4789-9476-da6223cbb53c tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158" status: 200 len: 286 microversion: 2.1 time: 0.061828 Sep 16 08:14:31.935591 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 533/1118] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Sep 16 08:14:31 2022] GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158 => generated 286 bytes in 63 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:14:31.954000 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-30df6c9b-bbcb-4b55-bcc1-a4b8d29886cc tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d06bc5ca0>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:31.991235 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-30df6c9b-bbcb-4b55-bcc1-a4b8d29886cc tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots" status: 200 len: 289 microversion: 2.1 time: 0.048244 Sep 16 08:14:31.991920 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 534/1119] 10.222.0.59 () {58 vars in 1140 bytes} [Fri Sep 16 08:14:31 2022] GET /compute/v2.1/os-snapshots => generated 289 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:14:32.004568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-cccd9b7a-2ef9-4588-a001-5144b6946bb4 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d06d92820>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:32.047151 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-cccd9b7a-2ef9-4588-a001-5144b6946bb4 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158" status: 200 len: 286 microversion: 2.1 time: 0.047532 Sep 16 08:14:32.047774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 535/1120] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Sep 16 08:14:31 2022] GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158 => generated 286 bytes in 49 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:14:32.080888 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=8 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:14:32.123227 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5c8ced87-d79e-42e0-b72b-2e99095b9a31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:32.131320 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5c8ced87-d79e-42e0-b72b-2e99095b9a31 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1318 microversion: 2.1 time: 0.291255 Sep 16 08:14:32.132065 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 586/1121] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:31 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1318 bytes in 293 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:14:33.062332 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-63f37a7a-8722-4b27-b073-70d66426f3d0 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d0685fc10>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:33.100571 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-63f37a7a-8722-4b27-b073-70d66426f3d0 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158" status: 200 len: 286 microversion: 2.1 time: 0.043200 Sep 16 08:14:33.100767 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 536/1122] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Sep 16 08:14:33 2022] GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158 => generated 286 bytes in 45 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:14:33.157054 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1be79288-3719-4fe8-92a7-4ba0f4490a34 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:33.158399 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1be79288-3719-4fe8-92a7-4ba0f4490a34 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:33.167859 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1be79288-3719-4fe8-92a7-4ba0f4490a34 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:33.168820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1be79288-3719-4fe8-92a7-4ba0f4490a34 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:33.170098 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1be79288-3719-4fe8-92a7-4ba0f4490a34 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:33.171136 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1be79288-3719-4fe8-92a7-4ba0f4490a34 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:33.171751 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1be79288-3719-4fe8-92a7-4ba0f4490a34 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:33.172336 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1be79288-3719-4fe8-92a7-4ba0f4490a34 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:33.654316 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1be79288-3719-4fe8-92a7-4ba0f4490a34 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:33.663915 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1be79288-3719-4fe8-92a7-4ba0f4490a34 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1318 microversion: 2.1 time: 0.511847 Sep 16 08:14:33.664650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 587/1123] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:33 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1318 bytes in 513 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:34.113895 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-b2176045-e880-4dcd-ab98-724e34545443 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d06ad48b0>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:34.147776 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-b2176045-e880-4dcd-ab98-724e34545443 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158" status: 200 len: 286 microversion: 2.1 time: 0.038476 Sep 16 08:14:34.148477 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 537/1124] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Sep 16 08:14:34 2022] GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158 => generated 286 bytes in 40 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:14:34.688958 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f5e24cea-0366-4f20-80ed-05e7c36081a2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:34.689593 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f5e24cea-0366-4f20-80ed-05e7c36081a2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:34.696743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5e24cea-0366-4f20-80ed-05e7c36081a2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:34.697242 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5e24cea-0366-4f20-80ed-05e7c36081a2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:34.697689 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5e24cea-0366-4f20-80ed-05e7c36081a2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:34.698422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5e24cea-0366-4f20-80ed-05e7c36081a2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:34.699506 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5e24cea-0366-4f20-80ed-05e7c36081a2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:34.700118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5e24cea-0366-4f20-80ed-05e7c36081a2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:34.926477 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f5e24cea-0366-4f20-80ed-05e7c36081a2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:34.935561 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f5e24cea-0366-4f20-80ed-05e7c36081a2 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1318 microversion: 2.1 time: 0.250463 Sep 16 08:14:34.936142 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 588/1125] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:34 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1318 bytes in 252 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:35.163220 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-bb620e44-b24d-412b-a700-3e6d5c37f864 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d06fc79d0>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:35.208339 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-bb620e44-b24d-412b-a700-3e6d5c37f864 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158" status: 200 len: 286 microversion: 2.1 time: 0.050225 Sep 16 08:14:35.215069 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 538/1126] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Sep 16 08:14:35 2022] GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158 => generated 286 bytes in 58 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:14:35.960365 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e6fd21ed-81fe-48e8-ad4a-b06d5928a1dc tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:35.961727 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e6fd21ed-81fe-48e8-ad4a-b06d5928a1dc tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:35.968829 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e6fd21ed-81fe-48e8-ad4a-b06d5928a1dc tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:35.969458 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e6fd21ed-81fe-48e8-ad4a-b06d5928a1dc tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:35.969995 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e6fd21ed-81fe-48e8-ad4a-b06d5928a1dc tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:35.970833 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e6fd21ed-81fe-48e8-ad4a-b06d5928a1dc tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:35.971524 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e6fd21ed-81fe-48e8-ad4a-b06d5928a1dc tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:35.972177 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e6fd21ed-81fe-48e8-ad4a-b06d5928a1dc tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:36.193271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e6fd21ed-81fe-48e8-ad4a-b06d5928a1dc tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:36.203558 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e6fd21ed-81fe-48e8-ad4a-b06d5928a1dc tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1318 microversion: 2.1 time: 0.246961 Sep 16 08:14:36.204404 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 589/1127] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:35 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1318 bytes in 249 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:36.228353 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e39ba254-5e81-40e2-87ea-eb582c988a4b tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d0685f160>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:36.262394 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e39ba254-5e81-40e2-87ea-eb582c988a4b tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158" status: 200 len: 287 microversion: 2.1 time: 0.038646 Sep 16 08:14:36.264665 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 539/1128] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Sep 16 08:14:36 2022] GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158 => generated 287 bytes in 42 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:14:36.276167 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8265f6f7-979d-4e6c-bbfc-613b7e8fc9b9 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d06a7f820>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:36.477998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8265f6f7-979d-4e6c-bbfc-613b7e8fc9b9 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "DELETE /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158" status: 202 len: 0 microversion: 2.1 time: 0.202516 Sep 16 08:14:36.477998 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 590/1129] 10.222.0.59 () {58 vars in 1254 bytes} [Fri Sep 16 08:14:36 2022] DELETE /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158 => generated 0 bytes in 204 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:14:36.483582 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-00ade9bc-e4ea-410a-a849-0534845a41e9 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d0685a040>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:36.518911 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-00ade9bc-e4ea-410a-a849-0534845a41e9 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158" status: 200 len: 286 microversion: 2.1 time: 0.039144 Sep 16 08:14:36.519632 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 540/1130] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Sep 16 08:14:36 2022] GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158 => generated 286 bytes in 41 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:14:37.228235 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-93c22f43-83d0-4f04-80e2-344a9b70e342 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:37.228699 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-93c22f43-83d0-4f04-80e2-344a9b70e342 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:37.237470 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93c22f43-83d0-4f04-80e2-344a9b70e342 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:37.238410 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93c22f43-83d0-4f04-80e2-344a9b70e342 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:37.239116 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93c22f43-83d0-4f04-80e2-344a9b70e342 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:37.240028 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93c22f43-83d0-4f04-80e2-344a9b70e342 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:37.240832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93c22f43-83d0-4f04-80e2-344a9b70e342 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:37.241437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-93c22f43-83d0-4f04-80e2-344a9b70e342 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:37.388527 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-93c22f43-83d0-4f04-80e2-344a9b70e342 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:37.397412 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-93c22f43-83d0-4f04-80e2-344a9b70e342 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1318 microversion: 2.1 time: 0.174303 Sep 16 08:14:37.398753 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 591/1131] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:37 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1318 bytes in 176 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:37.450403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-d4e20529-f900-42e5-ab32-93adb878ec1d req-cab166ed-b746-4d21-bfb0-9cf908e85ef9 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe729404-cdb5-4165-9882-3f7595ae2ac7", "name": "network-vif-plugged", "status": "completed", "tag": "8e4aeef0-48be-4b7b-93b1-8e29262b781c"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:14:37.474363 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-d4e20529-f900-42e5-ab32-93adb878ec1d req-cab166ed-b746-4d21-bfb0-9cf908e85ef9 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:37.476687 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-d4e20529-f900-42e5-ab32-93adb878ec1d req-cab166ed-b746-4d21-bfb0-9cf908e85ef9 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:37.477180 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-d4e20529-f900-42e5-ab32-93adb878ec1d req-cab166ed-b746-4d21-bfb0-9cf908e85ef9 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:37.495470 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-d4e20529-f900-42e5-ab32-93adb878ec1d req-cab166ed-b746-4d21-bfb0-9cf908e85ef9 service nova] Creating event network-vif-plugged:8e4aeef0-48be-4b7b-93b1-8e29262b781c for instance fe729404-cdb5-4165-9882-3f7595ae2ac7 on hv-cinder-74014 Sep 16 08:14:37.502406 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-d4e20529-f900-42e5-ab32-93adb878ec1d req-cab166ed-b746-4d21-bfb0-9cf908e85ef9 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.055817 Sep 16 08:14:37.503193 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 592/1132] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:14:37 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 59 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:14:37.532425 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-15bead25-6ae8-438e-9e89-bc1ca8d489ed tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d06b419d0>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:37.538358 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ac9e9067-b17a-485c-ac19-19d8172d9300 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Action: 'create', calling method: .version_select at 0x7f9d0685f820>, body: {"keypair": {"name": "tempest-TestShelveInstance-262311822", "public_key": "ecdsa-sha2-nistp384 AAAAE2VjZHNhLXNoYTItbmlzdHAzODQAAAAIbmlzdHAzODQAAABhBIWSbiJUv1pVSWF4tLGEwMdjGbLARyHZ1d5mSEYFUR0lYqGMSzZbZZ3HZOtYrD3Mv24q7BDClBLRYAG9cuyOeUBBlxdApmkPbtgXqu2yDO841+7mFrohuPu6JnRw8UzdKQ=="}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:14:37.555252 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-ac9e9067-b17a-485c-ac19-19d8172d9300 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Getting quotas for project 715b5f5887c940aca9d81291d48fd426. Resources: {'key_pairs'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:14:37.559544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.quota [None req-ac9e9067-b17a-485c-ac19-19d8172d9300 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Getting quotas for user 032d96be1a1146069299d83919adf7ce and project 715b5f5887c940aca9d81291d48fd426. Resources: {'key_pairs'} {{(pid=121047) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:14:37.567371 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-15bead25-6ae8-438e-9e89-bc1ca8d489ed tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] HTTP exception thrown: Snapshot 1684f21d-be69-4f22-8f50-21920cdfa158 could not be found. Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-15bead25-6ae8-438e-9e89-bc1ca8d489ed tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Request method failure captured: Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158 HTTP/1.1 Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJDBl4Yl_NDm_6ecVBRUz0_RDP6rbXaS5J1y7pRBOeJxFEm9LuFbePIp5nQhH_CFHI6L6dSGgxebtNajMqgKaOEkjCPfciiaBBrTEGrIv6NsDtUpL-b1E4_uJXS-HNNSnmFxvrX0SMNN-vaoc6oOhD1AEVI_GE7Jwjlf5TJ8W0Vo0i3w Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 31385ece156c4648a757d94a8e27d594 Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1835096344 Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:14:37.573957 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/31385ece156c4648a757d94a8e27d594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/31385ece156c4648a757d94a8e27d594"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_31385ece156c4648a757d94a8e27d594", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/31385ece156c4648a757d94a8e27d594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1835096344 Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 31385ece156c4648a757d94a8e27d594 Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1835096344 Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-VolumesSnapshotsTestJSON-1835096344-project Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: b33ff0a4f1a04b6eb2d4ef9dd7480c49 Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1835096344-project Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Snapshot 1684f21d-be69-4f22-8f50-21920cdfa158 could not be found. Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '1684f21d-be69-4f22-8f50-21920cdfa158'} Sep 16 08:14:37.575923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Snapshot 1684f21d-be69-4f22-8f50-21920cdfa158 could not be found. (HTTP 404) (Request-ID: req-2390295a-479a-48e4-ad60-c905efa40002) Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:37.577057 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 617, in show Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get_snapshot(context, id) Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 466, in wrapper Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi _reraise(exception.SnapshotNotFound(snapshot_id=snapshot_id)) Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 464, in wrapper Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, snapshot_id, *args, **kwargs) Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 701, in get_snapshot Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi item = cinderclient(context).volume_snapshots.get(snapshot_id) Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volume_snapshots.py", line 160, in get Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._get("/snapshots/%s" % snapshot_id, "snapshot") Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 08:14:37.578582 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.SnapshotNotFound: Snapshot 1684f21d-be69-4f22-8f50-21920cdfa158 could not be found. Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 619, in show Sep 16 08:14:37.580101 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:14:37.581710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Snapshot 1684f21d-be69-4f22-8f50-21920cdfa158 could not be found. Sep 16 08:14:37.581710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:37.581710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:37.581710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:37.581710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:37.581710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:37.581710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:37.581710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:14:37.581710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:14:37.581710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Snapshot 1684f21d-be69-4f22-8f50-21920cdfa158 could not be found. Sep 16 08:14:37.581710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:37.583707 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-15bead25-6ae8-438e-9e89-bc1ca8d489ed tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Returning 404 to user: Snapshot 1684f21d-be69-4f22-8f50-21920cdfa158 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:14:37.585125 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-15bead25-6ae8-438e-9e89-bc1ca8d489ed tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158" status: 404 len: 111 microversion: 2.1 time: 0.057468 Sep 16 08:14:37.585710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 593/1133] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Sep 16 08:14:37 2022] GET /compute/v2.1/os-snapshots/1684f21d-be69-4f22-8f50-21920cdfa158 => generated 111 bytes in 59 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:14:37.595021 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-7f8b8712-60a4-470f-9114-40e7e40af90e tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d06ba6550>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:37.646236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ac9e9067-b17a-485c-ac19-19d8172d9300 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "POST /compute/v2.1/os-keypairs" status: 200 len: 396 microversion: 2.1 time: 0.348267 Sep 16 08:14:37.647027 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 541/1134] 10.222.0.59 () {60 vars in 1159 bytes} [Fri Sep 16 08:14:37 2022] POST /compute/v2.1/os-keypairs => generated 396 bytes in 350 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:14:37.755285 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-7f8b8712-60a4-470f-9114-40e7e40af90e tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda" status: 202 len: 0 microversion: 2.1 time: 0.165092 Sep 16 08:14:37.755870 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 594/1135] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Sep 16 08:14:37 2022] DELETE /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda => generated 0 bytes in 166 msecs (HTTP/1.1 202) 9 headers in 361 bytes (2 switches on core 0) Sep 16 08:14:37.764252 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c4cc86ba-aefb-4798-b463-0d2257d8fcd8 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d068c3160>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:37.821209 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c4cc86ba-aefb-4798-b463-0d2257d8fcd8 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda" status: 200 len: 344 microversion: 2.1 time: 0.060930 Sep 16 08:14:37.824079 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 542/1136] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:14:37 2022] GET /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda => generated 344 bytes in 62 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:14:38.422670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5b8d3b56-fada-42ae-87a2-563f88549e41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:38.424482 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5b8d3b56-fada-42ae-87a2-563f88549e41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:38.431780 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b8d3b56-fada-42ae-87a2-563f88549e41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:38.432277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b8d3b56-fada-42ae-87a2-563f88549e41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:38.432727 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b8d3b56-fada-42ae-87a2-563f88549e41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:38.433438 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b8d3b56-fada-42ae-87a2-563f88549e41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:38.433904 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b8d3b56-fada-42ae-87a2-563f88549e41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:38.434338 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5b8d3b56-fada-42ae-87a2-563f88549e41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:38.574973 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5b8d3b56-fada-42ae-87a2-563f88549e41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:38.581797 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5b8d3b56-fada-42ae-87a2-563f88549e41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1318 microversion: 2.1 time: 0.163411 Sep 16 08:14:38.591465 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 595/1137] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:38 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1318 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:38.836653 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6c2cd899-d416-456b-953d-1abe46540c29 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d06da7280>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:38.873645 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-6c2cd899-d416-456b-953d-1abe46540c29 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] HTTP exception thrown: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6c2cd899-d416-456b-953d-1abe46540c29 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Request method failure captured: Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda HTTP/1.1 Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJDBl4Yl_NDm_6ecVBRUz0_RDP6rbXaS5J1y7pRBOeJxFEm9LuFbePIp5nQhH_CFHI6L6dSGgxebtNajMqgKaOEkjCPfciiaBBrTEGrIv6NsDtUpL-b1E4_uJXS-HNNSnmFxvrX0SMNN-vaoc6oOhD1AEVI_GE7Jwjlf5TJ8W0Vo0i3w Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 31385ece156c4648a757d94a8e27d594 Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1835096344 Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:14:38.875850 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/31385ece156c4648a757d94a8e27d594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/31385ece156c4648a757d94a8e27d594"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_31385ece156c4648a757d94a8e27d594", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/31385ece156c4648a757d94a8e27d594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1835096344 Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 31385ece156c4648a757d94a8e27d594 Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1835096344 Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-VolumesSnapshotsTestJSON-1835096344-project Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: b33ff0a4f1a04b6eb2d4ef9dd7480c49 Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1835096344-project Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': 'e23c7046-84d1-4ad8-b564-a0717a79adda'} Sep 16 08:14:38.877564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. (HTTP 404) (Request-ID: req-d8b44263-be8b-4109-85ab-0b83f14ea724) Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:38.878484 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 08:14:38.882088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 08:14:38.883428 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6c2cd899-d416-456b-953d-1abe46540c29 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Returning 404 to user: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6c2cd899-d416-456b-953d-1abe46540c29 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda" status: 404 len: 109 microversion: 2.1 time: 0.045205 Sep 16 08:14:38.884731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 543/1138] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:14:38 2022] GET /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda => generated 109 bytes in 46 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:14:38.892505 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f294af42-5139-4802-aa00-10e9e9eff022 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d06ba6040>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:38.922166 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-f294af42-5139-4802-aa00-10e9e9eff022 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] HTTP exception thrown: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f294af42-5139-4802-aa00-10e9e9eff022 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Request method failure captured: Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: DELETE /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda HTTP/1.1 Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJDBl4Yl_NDm_6ecVBRUz0_RDP6rbXaS5J1y7pRBOeJxFEm9LuFbePIp5nQhH_CFHI6L6dSGgxebtNajMqgKaOEkjCPfciiaBBrTEGrIv6NsDtUpL-b1E4_uJXS-HNNSnmFxvrX0SMNN-vaoc6oOhD1AEVI_GE7Jwjlf5TJ8W0Vo0i3w Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 31385ece156c4648a757d94a8e27d594 Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1835096344 Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:14:38.924238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/31385ece156c4648a757d94a8e27d594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/31385ece156c4648a757d94a8e27d594"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_31385ece156c4648a757d94a8e27d594", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/31385ece156c4648a757d94a8e27d594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1835096344 Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 31385ece156c4648a757d94a8e27d594 Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1835096344 Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-VolumesSnapshotsTestJSON-1835096344-project Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: b33ff0a4f1a04b6eb2d4ef9dd7480c49 Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1835096344-project Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': 'e23c7046-84d1-4ad8-b564-a0717a79adda'} Sep 16 08:14:38.925890 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. (HTTP 404) (Request-ID: req-b9cbbc86-850d-446c-aebc-d7482197e964) Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:38.927218 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 136, in delete Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi self.volume_api.delete(context, id) Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 676, in delete Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi cinderclient(context).volumes.delete(volume_id) Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 235, in delete Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._delete(loc) Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 313, in _delete Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.delete(url) Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 233, in delete Sep 16 08:14:38.928663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'DELETE', **kwargs) Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 140, in delete Sep 16 08:14:38.930123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f294af42-5139-4802-aa00-10e9e9eff022 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Returning 404 to user: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:14:38.931714 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f294af42-5139-4802-aa00-10e9e9eff022 tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "DELETE /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda" status: 404 len: 109 microversion: 2.1 time: 0.038085 Sep 16 08:14:38.932845 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 596/1139] 10.222.0.59 () {58 vars in 1248 bytes} [Fri Sep 16 08:14:38 2022] DELETE /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda => generated 109 bytes in 39 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:14:38.936473 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-990b9857-a6d1-47d7-ada4-839e50dd39ec tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Calling method '.version_select at 0x7f9d068c3310>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:38.965859 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-990b9857-a6d1-47d7-ada4-839e50dd39ec tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] HTTP exception thrown: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-990b9857-a6d1-47d7-ada4-839e50dd39ec tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Request method failure captured: Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda HTTP/1.1 Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJDBl4Yl_NDm_6ecVBRUz0_RDP6rbXaS5J1y7pRBOeJxFEm9LuFbePIp5nQhH_CFHI6L6dSGgxebtNajMqgKaOEkjCPfciiaBBrTEGrIv6NsDtUpL-b1E4_uJXS-HNNSnmFxvrX0SMNN-vaoc6oOhD1AEVI_GE7Jwjlf5TJ8W0Vo0i3w Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 31385ece156c4648a757d94a8e27d594 Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-VolumesSnapshotsTestJSON-1835096344 Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:14:38.968062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/31385ece156c4648a757d94a8e27d594"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/31385ece156c4648a757d94a8e27d594"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_31385ece156c4648a757d94a8e27d594", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/31385ece156c4648a757d94a8e27d594"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-VolumesSnapshotsTestJSON-1835096344 Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 31385ece156c4648a757d94a8e27d594 Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-VolumesSnapshotsTestJSON-1835096344 Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-VolumesSnapshotsTestJSON-1835096344-project Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: b33ff0a4f1a04b6eb2d4ef9dd7480c49 Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-VolumesSnapshotsTestJSON-1835096344-project Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': 'e23c7046-84d1-4ad8-b564-a0717a79adda'} Sep 16 08:14:38.969812 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi cinderclient.exceptions.NotFound: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. (HTTP 404) (Request-ID: req-ecb5bb5b-430a-4e32-84c2-ea458645c742) Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:38.970883 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 120, in show Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi vol = self.volume_api.get(context, id) Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 395, in wrapper Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, *args, **kwargs) Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 435, in wrapper Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi _reraise(exception.VolumeNotFound(volume_id=volume_id)) Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 486, in _reraise Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise desired_exc.with_traceback(sys.exc_info()[2]) Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 433, in wrapper Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi res = method(self, ctx, volume_id, *args, **kwargs) Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/volume/cinder.py", line 502, in get Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi item = cinderclient( Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/v3/volumes_base.py", line 202, in get Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self._get("/volumes/%s" % volume_id, "volume") Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/base.py", line 297, in _get Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi resp, body = self.api.client.get(url) Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 224, in get Sep 16 08:14:38.972301 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self._cs_request(url, 'GET', **kwargs) Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 215, in _cs_request Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return self.request(url, method, **kwargs) Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/usr/local/lib/python3.8/dist-packages/cinderclient/client.py", line 201, in request Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exceptions.from_response(resp, body) Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.VolumeNotFound: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 794, in version_select Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return func.func(self, *args, **kwargs) Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/volumes.py", line 122, in show Sep 16 08:14:38.973857 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-990b9857-a6d1-47d7-ada4-839e50dd39ec tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] Returning 404 to user: Volume e23c7046-84d1-4ad8-b564-a0717a79adda could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-990b9857-a6d1-47d7-ada4-839e50dd39ec tempest-VolumesSnapshotsTestJSON-1835096344 tempest-VolumesSnapshotsTestJSON-1835096344-project] 10.222.0.59 "GET /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda" status: 404 len: 109 microversion: 2.1 time: 0.039397 Sep 16 08:14:38.976030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 544/1140] 10.222.0.59 () {58 vars in 1245 bytes} [Fri Sep 16 08:14:38 2022] GET /compute/v2.1/os-volumes/e23c7046-84d1-4ad8-b564-a0717a79adda => generated 109 bytes in 45 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:14:39.606037 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dbec8976-6573-4fcb-8bdc-3b6a1741258f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:39.612262 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dbec8976-6573-4fcb-8bdc-3b6a1741258f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:39.616428 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dbec8976-6573-4fcb-8bdc-3b6a1741258f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:39.617004 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dbec8976-6573-4fcb-8bdc-3b6a1741258f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:39.617528 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dbec8976-6573-4fcb-8bdc-3b6a1741258f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:39.618883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dbec8976-6573-4fcb-8bdc-3b6a1741258f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:39.619417 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dbec8976-6573-4fcb-8bdc-3b6a1741258f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:39.620063 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dbec8976-6573-4fcb-8bdc-3b6a1741258f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:39.781118 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dbec8976-6573-4fcb-8bdc-3b6a1741258f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:39.790599 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dbec8976-6573-4fcb-8bdc-3b6a1741258f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1318 microversion: 2.1 time: 0.188902 Sep 16 08:14:39.796115 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 597/1141] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:39 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1318 bytes in 191 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:40.818065 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ff73b804-caac-415e-858e-eb08c96e2f93 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:14:40.818790 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ff73b804-caac-415e-858e-eb08c96e2f93 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:40.821276 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=27 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:14:40.826440 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ff73b804-caac-415e-858e-eb08c96e2f93 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:40.826963 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ff73b804-caac-415e-858e-eb08c96e2f93 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:40.827407 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ff73b804-caac-415e-858e-eb08c96e2f93 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:40.828120 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ff73b804-caac-415e-858e-eb08c96e2f93 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:40.828584 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ff73b804-caac-415e-858e-eb08c96e2f93 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:40.829016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ff73b804-caac-415e-858e-eb08c96e2f93 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:40.992559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ff73b804-caac-415e-858e-eb08c96e2f93 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:14:41.001534 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ff73b804-caac-415e-858e-eb08c96e2f93 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1506 microversion: 2.1 time: 0.187941 Sep 16 08:14:41.002118 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 545/1142] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:14:40 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1506 bytes in 189 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:14:41.027558 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-924435a1-c2c4-46a9-a6d9-1835e4180025 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Action: 'create', calling method: >, body: {"volumeAttachment": {"volumeId": "bba8eeba-3f3e-4d1a-868f-98efb5fa555d", "device": "/dev/sdb"}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:14:41.031354 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-924435a1-c2c4-46a9-a6d9-1835e4180025 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:14:41.038718 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-924435a1-c2c4-46a9-a6d9-1835e4180025 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:41.040422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-924435a1-c2c4-46a9-a6d9-1835e4180025 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:41.040422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-924435a1-c2c4-46a9-a6d9-1835e4180025 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:41.040837 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-924435a1-c2c4-46a9-a6d9-1835e4180025 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:14:41.041371 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-924435a1-c2c4-46a9-a6d9-1835e4180025 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:14:41.041921 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-924435a1-c2c4-46a9-a6d9-1835e4180025 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:14:41.779514 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-924435a1-c2c4-46a9-a6d9-1835e4180025 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "POST /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7/os-volume_attachments" status: 200 len: 194 microversion: 2.1 time: 0.756172 Sep 16 08:14:41.780122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 598/1143] 10.222.0.59 () {60 vars in 1323 bytes} [Fri Sep 16 08:14:41 2022] POST /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7/os-volume_attachments => generated 194 bytes in 758 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:15:01.904432 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2682ee09-20d2-49fe-a3f5-bda649521fac tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:01.904942 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2682ee09-20d2-49fe-a3f5-bda649521fac tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:01.906790 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=4 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:01.907503 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=14,nova_api:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:01.908180 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=6 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:01.912984 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2682ee09-20d2-49fe-a3f5-bda649521fac tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:01.913461 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2682ee09-20d2-49fe-a3f5-bda649521fac tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:01.913896 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2682ee09-20d2-49fe-a3f5-bda649521fac tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:01.914806 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2682ee09-20d2-49fe-a3f5-bda649521fac tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:01.915273 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2682ee09-20d2-49fe-a3f5-bda649521fac tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:01.915695 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2682ee09-20d2-49fe-a3f5-bda649521fac tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:01.996595 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-2682ee09-20d2-49fe-a3f5-bda649521fac tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lazy-loading 'services' on Instance uuid fe729404-cdb5-4165-9882-3f7595ae2ac7 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:15:02.173154 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2682ee09-20d2-49fe-a3f5-bda649521fac tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7/os-volume_attachments/bba8eeba-3f3e-4d1a-868f-98efb5fa555d" status: 202 len: 0 microversion: 2.1 time: 0.272784 Sep 16 08:15:02.191855 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 546/1144] 10.222.0.59 () {58 vars in 1416 bytes} [Fri Sep 16 08:15:01 2022] DELETE /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7/os-volume_attachments/bba8eeba-3f3e-4d1a-868f-98efb5fa555d => generated 0 bytes in 292 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:15:03.278338 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-TestShelveInstance-server-1373478764", "imageRef": "", "flavorRef": "452", "key_name": "tempest-TestShelveInstance-262311822", "security_groups": [{"name": "tempest-secgroup-smoke-748301494"}], "networks": [{"uuid": "930720f1-5a77-4f98-8ee8-8dfe2ce7d18b"}], "block_device_mapping_v2": [{"uuid": "c41ec9ba-a0f6-492d-a48d-6d85ecdc46f7", "source_type": "volume", "destination_type": "volume", "boot_index": 0, "delete_on_termination": true}]}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:15:03.291113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=23 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:03.291574 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=68,nova_cell1:UPDATE=2,nova_cell1:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:03.399562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.network.neutron [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] validate_networks() for [('930720f1-5a77-4f98-8ee8-8dfe2ce7d18b', None, None, None, None, None)] {{(pid=121046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:15:03.773584 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Flavor limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:15:03.774145 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Image limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:15:03.774640 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Flavor pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:15:03.775121 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Image pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:15:03.775541 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:15:03.785259 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:03.785742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:03.786181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:03.786938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:03.787397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:03.787824 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:03.805114 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Getting quotas for project 715b5f5887c940aca9d81291d48fd426. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:15:03.809200 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Getting quotas for user 032d96be1a1146069299d83919adf7ce and project 715b5f5887c940aca9d81291d48fd426. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:15:03.864784 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Going to run 1 instances... {{(pid=121046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:15:03.867033 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='volume',device_name=None,device_type=None,disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id=None,instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='volume',tag=None,updated_at=,uuid=,volume_id='c41ec9ba-a0f6-492d-a48d-6d85ecdc46f7',volume_size=None,volume_type=None)] {{(pid=121046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:15:04.228343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c0cb546f-6d29-46a4-90ca-d7d7363aa1b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 405 microversion: 2.1 time: 0.954587 Sep 16 08:15:04.229192 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 599/1145] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:15:03 2022] POST /compute/v2.1/servers => generated 405 bytes in 956 msecs (HTTP/1.1 202) 10 headers in 451 bytes (2 switches on core 0) Sep 16 08:15:04.241214 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-170501ee-f1eb-44b6-9b5a-833239da38de tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:04.248585 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-170501ee-f1eb-44b6-9b5a-833239da38de tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:04.304670 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-170501ee-f1eb-44b6-9b5a-833239da38de tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:04.313290 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-170501ee-f1eb-44b6-9b5a-833239da38de tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1088 microversion: 2.1 time: 0.076169 Sep 16 08:15:04.313921 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 547/1146] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:04 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1088 bytes in 78 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:04.388623 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4ad5ac0a-0688-418a-80f5-2f8d8e7abc41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:04.389131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4ad5ac0a-0688-418a-80f5-2f8d8e7abc41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:04.397174 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ad5ac0a-0688-418a-80f5-2f8d8e7abc41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:04.398015 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ad5ac0a-0688-418a-80f5-2f8d8e7abc41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:04.398715 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ad5ac0a-0688-418a-80f5-2f8d8e7abc41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:04.399535 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ad5ac0a-0688-418a-80f5-2f8d8e7abc41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:04.400062 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ad5ac0a-0688-418a-80f5-2f8d8e7abc41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:04.400552 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ad5ac0a-0688-418a-80f5-2f8d8e7abc41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:04.426088 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4ad5ac0a-0688-418a-80f5-2f8d8e7abc41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:15:04.752480 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4ad5ac0a-0688-418a-80f5-2f8d8e7abc41 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "DELETE /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 204 len: 0 microversion: 2.1 time: 0.367560 Sep 16 08:15:04.753157 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 600/1147] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:15:04 2022] DELETE /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 0 bytes in 369 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:15:04.761427 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-8a9678d0-5d7c-4af2-8f09-22b13c9e042d tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:04.762040 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-8a9678d0-5d7c-4af2-8f09-22b13c9e042d tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:04.769203 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8a9678d0-5d7c-4af2-8f09-22b13c9e042d tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:04.769683 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8a9678d0-5d7c-4af2-8f09-22b13c9e042d tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:04.770116 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8a9678d0-5d7c-4af2-8f09-22b13c9e042d tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:04.770846 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8a9678d0-5d7c-4af2-8f09-22b13c9e042d tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:04.771299 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8a9678d0-5d7c-4af2-8f09-22b13c9e042d tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:04.771724 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8a9678d0-5d7c-4af2-8f09-22b13c9e042d tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:04.909487 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-8a9678d0-5d7c-4af2-8f09-22b13c9e042d tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:04.918421 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-8a9678d0-5d7c-4af2-8f09-22b13c9e042d tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1512 microversion: 2.1 time: 0.159797 Sep 16 08:15:04.918421 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 548/1148] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:04 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1512 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:05.337002 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-6c75ba03-9a80-4781-b83a-1fbd7a40ff00 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:05.337883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-6c75ba03-9a80-4781-b83a-1fbd7a40ff00 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:05.344823 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6c75ba03-9a80-4781-b83a-1fbd7a40ff00 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:05.349369 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6c75ba03-9a80-4781-b83a-1fbd7a40ff00 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:05.349369 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6c75ba03-9a80-4781-b83a-1fbd7a40ff00 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:05.349369 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6c75ba03-9a80-4781-b83a-1fbd7a40ff00 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:05.349369 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6c75ba03-9a80-4781-b83a-1fbd7a40ff00 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:05.349782 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-6c75ba03-9a80-4781-b83a-1fbd7a40ff00 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:05.413602 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-6c75ba03-9a80-4781-b83a-1fbd7a40ff00 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:05.421464 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-6c75ba03-9a80-4781-b83a-1fbd7a40ff00 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1138 microversion: 2.1 time: 0.088596 Sep 16 08:15:05.422231 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 601/1149] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:05 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1138 bytes in 90 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:05.940718 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-a3dd653c-6106-435c-b232-e6906943ba00 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:05.941345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-a3dd653c-6106-435c-b232-e6906943ba00 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:05.947851 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a3dd653c-6106-435c-b232-e6906943ba00 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:05.948337 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a3dd653c-6106-435c-b232-e6906943ba00 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:05.948774 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a3dd653c-6106-435c-b232-e6906943ba00 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:05.949470 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a3dd653c-6106-435c-b232-e6906943ba00 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:05.949923 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a3dd653c-6106-435c-b232-e6906943ba00 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:05.950354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-a3dd653c-6106-435c-b232-e6906943ba00 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:06.083715 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-a3dd653c-6106-435c-b232-e6906943ba00 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:06.091548 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-a3dd653c-6106-435c-b232-e6906943ba00 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1512 microversion: 2.1 time: 0.154687 Sep 16 08:15:06.096887 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 549/1150] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:05 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1512 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:06.444758 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cba07805-e362-4fec-93e4-37b0b686a2b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:06.445686 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cba07805-e362-4fec-93e4-37b0b686a2b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:06.453589 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cba07805-e362-4fec-93e4-37b0b686a2b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:06.454204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cba07805-e362-4fec-93e4-37b0b686a2b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:06.454744 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cba07805-e362-4fec-93e4-37b0b686a2b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:06.455487 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cba07805-e362-4fec-93e4-37b0b686a2b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:06.455955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cba07805-e362-4fec-93e4-37b0b686a2b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:06.456396 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cba07805-e362-4fec-93e4-37b0b686a2b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:06.520607 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cba07805-e362-4fec-93e4-37b0b686a2b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:06.528713 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cba07805-e362-4fec-93e4-37b0b686a2b2 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1138 microversion: 2.1 time: 0.087825 Sep 16 08:15:06.529282 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 602/1151] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:06 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1138 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:07.118942 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-10b0b8e4-08a5-454b-a839-acdc935d8017 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:07.119557 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-10b0b8e4-08a5-454b-a839-acdc935d8017 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:07.147042 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-10b0b8e4-08a5-454b-a839-acdc935d8017 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:07.147042 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-10b0b8e4-08a5-454b-a839-acdc935d8017 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:07.147042 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-10b0b8e4-08a5-454b-a839-acdc935d8017 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:07.147042 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-10b0b8e4-08a5-454b-a839-acdc935d8017 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:07.148100 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-10b0b8e4-08a5-454b-a839-acdc935d8017 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:07.148100 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-10b0b8e4-08a5-454b-a839-acdc935d8017 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:07.303580 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-10b0b8e4-08a5-454b-a839-acdc935d8017 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:07.313739 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-10b0b8e4-08a5-454b-a839-acdc935d8017 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1512 microversion: 2.1 time: 0.199555 Sep 16 08:15:07.315308 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 550/1152] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:07 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1512 bytes in 202 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:07.556334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1021c34c-1a67-40fe-a7ab-8c864ab1991f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:07.557108 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1021c34c-1a67-40fe-a7ab-8c864ab1991f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:07.564467 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1021c34c-1a67-40fe-a7ab-8c864ab1991f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:07.565157 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1021c34c-1a67-40fe-a7ab-8c864ab1991f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:07.565684 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1021c34c-1a67-40fe-a7ab-8c864ab1991f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:07.566746 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1021c34c-1a67-40fe-a7ab-8c864ab1991f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:07.567788 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1021c34c-1a67-40fe-a7ab-8c864ab1991f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:07.568351 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1021c34c-1a67-40fe-a7ab-8c864ab1991f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:07.660938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1021c34c-1a67-40fe-a7ab-8c864ab1991f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:07.670099 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1021c34c-1a67-40fe-a7ab-8c864ab1991f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1186 microversion: 2.1 time: 0.121694 Sep 16 08:15:07.670894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 603/1153] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:07 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1186 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:07.672324 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-d3f53e78-b881-4681-825c-816f09304508 req-20c0f4d2-c634-4640-8462-8dd21cf2e070 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "fe729404-cdb5-4165-9882-3f7595ae2ac7", "name": "network-vif-deleted", "tag": "8e4aeef0-48be-4b7b-93b1-8e29262b781c"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:15:07.682138 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-d3f53e78-b881-4681-825c-816f09304508 req-20c0f4d2-c634-4640-8462-8dd21cf2e070 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:07.682732 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-d3f53e78-b881-4681-825c-816f09304508 req-20c0f4d2-c634-4640-8462-8dd21cf2e070 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:07.683235 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-d3f53e78-b881-4681-825c-816f09304508 req-20c0f4d2-c634-4640-8462-8dd21cf2e070 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:07.696178 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-d3f53e78-b881-4681-825c-816f09304508 req-20c0f4d2-c634-4640-8462-8dd21cf2e070 service nova] Creating event network-vif-deleted:8e4aeef0-48be-4b7b-93b1-8e29262b781c for instance fe729404-cdb5-4165-9882-3f7595ae2ac7 on hv-cinder-74014 Sep 16 08:15:07.701399 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-d3f53e78-b881-4681-825c-816f09304508 req-20c0f4d2-c634-4640-8462-8dd21cf2e070 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032811 Sep 16 08:15:07.701971 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 551/1154] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:15:07 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (2 switches on core 0) Sep 16 08:15:08.337489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:08.339633 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:08.346432 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:08.347524 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:08.348867 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:08.350129 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:08.351437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:08.351995 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:08.390473 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:08.390997 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:08.394170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:08.394170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lazy-loading 'fault' on Instance uuid fe729404-cdb5-4165-9882-3f7595ae2ac7 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:15:08.444298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'cc14169c8f7044c6815944af5bc658a9', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': 'e3276981b48d4974841dd97ee1cb9882', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:08.452334 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-653fc7f3-59ab-4420-8c7a-a87f8ad509c1 tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 200 len: 1308 microversion: 2.1 time: 0.118750 Sep 16 08:15:08.461750 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 604/1155] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:08 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 1308 bytes in 120 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:08.698357 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c443b438-3946-45ed-9e07-1e691c4ae869 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:08.699170 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c443b438-3946-45ed-9e07-1e691c4ae869 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:08.706300 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c443b438-3946-45ed-9e07-1e691c4ae869 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:08.706977 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c443b438-3946-45ed-9e07-1e691c4ae869 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:08.707406 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c443b438-3946-45ed-9e07-1e691c4ae869 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:08.708139 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c443b438-3946-45ed-9e07-1e691c4ae869 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:08.708602 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c443b438-3946-45ed-9e07-1e691c4ae869 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:08.709046 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c443b438-3946-45ed-9e07-1e691c4ae869 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:08.864881 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c443b438-3946-45ed-9e07-1e691c4ae869 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:08.866816 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c443b438-3946-45ed-9e07-1e691c4ae869 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1271 microversion: 2.1 time: 0.176423 Sep 16 08:15:08.867398 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 552/1156] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:08 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1271 bytes in 178 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:09.475534 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b85d935a-ece3-417e-b4c9-7b4c18a9e76f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:09.476151 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-b85d935a-ece3-417e-b4c9-7b4c18a9e76f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] [instance: fe729404-cdb5-4165-9882-3f7595ae2ac7] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:09.482538 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b85d935a-ece3-417e-b4c9-7b4c18a9e76f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:09.486456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b85d935a-ece3-417e-b4c9-7b4c18a9e76f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:09.486456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b85d935a-ece3-417e-b4c9-7b4c18a9e76f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:09.486456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b85d935a-ece3-417e-b4c9-7b4c18a9e76f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:09.486456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b85d935a-ece3-417e-b4c9-7b4c18a9e76f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:09.486877 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-b85d935a-ece3-417e-b4c9-7b4c18a9e76f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:09.498745 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-b85d935a-ece3-417e-b4c9-7b4c18a9e76f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] HTTP exception thrown: Instance fe729404-cdb5-4165-9882-3f7595ae2ac7 could not be found. Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b85d935a-ece3-417e-b4c9-7b4c18a9e76f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Request method failure captured: Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 HTTP/1.1 Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC_5afi8-AKk4W59S3MhGtR46yNvq8Mn6Hp0d2E2d4Jx0UAfr7D3vp3oWvOrFVycakj9kkRfNyTuK_sS3o0YrVSIN7Bi-x5TM9CNT4A1pYEHkTxQ9tRqEZ2xjZkXJ3PIi-YyElPqgqX-p-KpSG1WJSbrrXOBHAw9TEC_ojGYqpxUyH0 Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: e3276981b48d4974841dd97ee1cb9882 Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-VolumesSnapshotTestJSON-1366856393 Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:15:09.500317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:15:09.502648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3276981b48d4974841dd97ee1cb9882"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/e3276981b48d4974841dd97ee1cb9882"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_e3276981b48d4974841dd97ee1cb9882", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/e3276981b48d4974841dd97ee1cb9882"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:15:09.502648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-VolumesSnapshotTestJSON-1366856393 Sep 16 08:15:09.502648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: e3276981b48d4974841dd97ee1cb9882 Sep 16 08:15:09.502648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-VolumesSnapshotTestJSON-1366856393 Sep 16 08:15:09.502648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-VolumesSnapshotTestJSON-1366856393-project Sep 16 08:15:09.502648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:15:09.502648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:15:09.502648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: cc14169c8f7044c6815944af5bc658a9 Sep 16 08:15:09.502648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-VolumesSnapshotTestJSON-1366856393-project Sep 16 08:15:09.502648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:15:09.502648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance fe729404-cdb5-4165-9882-3f7595ae2ac7 could not be found. Sep 16 08:15:09.502648 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': 'fe729404-cdb5-4165-9882-3f7595ae2ac7'} Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance fe729404-cdb5-4165-9882-3f7595ae2ac7 could not be found. Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:15:09.503749 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance fe729404-cdb5-4165-9882-3f7595ae2ac7 could not be found. Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance fe729404-cdb5-4165-9882-3f7595ae2ac7 could not be found. Sep 16 08:15:09.505271 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:09.506833 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-b85d935a-ece3-417e-b4c9-7b4c18a9e76f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] Returning 404 to user: Instance fe729404-cdb5-4165-9882-3f7595ae2ac7 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:15:09.506833 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-b85d935a-ece3-417e-b4c9-7b4c18a9e76f tempest-VolumesSnapshotTestJSON-1366856393 tempest-VolumesSnapshotTestJSON-1366856393-project] 10.222.0.59 "GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7" status: 404 len: 111 microversion: 2.1 time: 0.030134 Sep 16 08:15:09.506833 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 605/1157] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:09 2022] GET /compute/v2.1/servers/fe729404-cdb5-4165-9882-3f7595ae2ac7 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:15:09.752224 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-05dbf606-3623-4fe5-a7d0-91ddf6f11408 req-2c181cdd-12fe-4211-aa51-a71b20b01d84 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "747eb003-d2cb-4458-9c34-b5f64b8ac764", "tag": "ffe6532b-6bcb-4c4c-a9aa-8071554bec05"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:15:09.762032 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-05dbf606-3623-4fe5-a7d0-91ddf6f11408 req-2c181cdd-12fe-4211-aa51-a71b20b01d84 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:09.762975 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-05dbf606-3623-4fe5-a7d0-91ddf6f11408 req-2c181cdd-12fe-4211-aa51-a71b20b01d84 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:09.762975 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-05dbf606-3623-4fe5-a7d0-91ddf6f11408 req-2c181cdd-12fe-4211-aa51-a71b20b01d84 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:09.774594 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-05dbf606-3623-4fe5-a7d0-91ddf6f11408 req-2c181cdd-12fe-4211-aa51-a71b20b01d84 service nova] Creating event network-changed:ffe6532b-6bcb-4c4c-a9aa-8071554bec05 for instance 747eb003-d2cb-4458-9c34-b5f64b8ac764 on hv-cinder-74014 Sep 16 08:15:09.779597 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-05dbf606-3623-4fe5-a7d0-91ddf6f11408 req-2c181cdd-12fe-4211-aa51-a71b20b01d84 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031823 Sep 16 08:15:09.780191 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 553/1158] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:15:09 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:15:09.890846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c36bc15d-4346-478c-b918-a10690d9b63b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:09.891449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c36bc15d-4346-478c-b918-a10690d9b63b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:09.897867 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c36bc15d-4346-478c-b918-a10690d9b63b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:09.898360 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c36bc15d-4346-478c-b918-a10690d9b63b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:09.898838 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c36bc15d-4346-478c-b918-a10690d9b63b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:09.899562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c36bc15d-4346-478c-b918-a10690d9b63b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:09.900022 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c36bc15d-4346-478c-b918-a10690d9b63b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:09.900447 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c36bc15d-4346-478c-b918-a10690d9b63b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:10.139782 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c36bc15d-4346-478c-b918-a10690d9b63b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:10.147750 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c36bc15d-4346-478c-b918-a10690d9b63b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1259 microversion: 2.1 time: 0.260823 Sep 16 08:15:10.148304 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 606/1159] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:09 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1259 bytes in 262 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:11.172254 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5cde515a-0dc5-4d9d-87ab-09c115333204 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:11.173037 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5cde515a-0dc5-4d9d-87ab-09c115333204 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:11.179488 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5cde515a-0dc5-4d9d-87ab-09c115333204 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:11.179980 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5cde515a-0dc5-4d9d-87ab-09c115333204 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:11.180424 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5cde515a-0dc5-4d9d-87ab-09c115333204 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:11.181178 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5cde515a-0dc5-4d9d-87ab-09c115333204 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:11.181645 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5cde515a-0dc5-4d9d-87ab-09c115333204 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:11.182217 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5cde515a-0dc5-4d9d-87ab-09c115333204 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:11.322054 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5cde515a-0dc5-4d9d-87ab-09c115333204 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:11.330048 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5cde515a-0dc5-4d9d-87ab-09c115333204 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1259 microversion: 2.1 time: 0.162807 Sep 16 08:15:11.330616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 554/1160] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:11 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:12.353309 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-e8ecd326-ad5e-40b8-b96b-3eb1931d885b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:12.353923 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-e8ecd326-ad5e-40b8-b96b-3eb1931d885b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:12.360450 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e8ecd326-ad5e-40b8-b96b-3eb1931d885b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:12.360983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e8ecd326-ad5e-40b8-b96b-3eb1931d885b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:12.361421 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e8ecd326-ad5e-40b8-b96b-3eb1931d885b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:12.362120 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e8ecd326-ad5e-40b8-b96b-3eb1931d885b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:12.362579 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e8ecd326-ad5e-40b8-b96b-3eb1931d885b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:12.363034 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-e8ecd326-ad5e-40b8-b96b-3eb1931d885b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:12.505415 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-e8ecd326-ad5e-40b8-b96b-3eb1931d885b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:12.513055 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-e8ecd326-ad5e-40b8-b96b-3eb1931d885b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1259 microversion: 2.1 time: 0.163575 Sep 16 08:15:12.513611 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 607/1161] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:12 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1259 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:13.536717 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-2a49a579-a4bf-47fa-8c42-5e7adfe49ffc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:13.537337 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-2a49a579-a4bf-47fa-8c42-5e7adfe49ffc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:13.543616 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a49a579-a4bf-47fa-8c42-5e7adfe49ffc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:13.544107 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a49a579-a4bf-47fa-8c42-5e7adfe49ffc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:13.544554 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a49a579-a4bf-47fa-8c42-5e7adfe49ffc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:13.545258 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a49a579-a4bf-47fa-8c42-5e7adfe49ffc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:13.545723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a49a579-a4bf-47fa-8c42-5e7adfe49ffc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:13.546160 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-2a49a579-a4bf-47fa-8c42-5e7adfe49ffc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:13.682059 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-2a49a579-a4bf-47fa-8c42-5e7adfe49ffc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:13.689941 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-2a49a579-a4bf-47fa-8c42-5e7adfe49ffc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1259 microversion: 2.1 time: 0.157622 Sep 16 08:15:13.690452 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 555/1162] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:13 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1259 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:15:14.712673 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-55ccce52-dd80-4807-9dcf-59adbfcb4d52 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:14.713295 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-55ccce52-dd80-4807-9dcf-59adbfcb4d52 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:14.715735 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:14.716455 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=6 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:14.721920 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55ccce52-dd80-4807-9dcf-59adbfcb4d52 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:14.722417 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55ccce52-dd80-4807-9dcf-59adbfcb4d52 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:14.722893 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55ccce52-dd80-4807-9dcf-59adbfcb4d52 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:14.723601 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55ccce52-dd80-4807-9dcf-59adbfcb4d52 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:14.724065 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55ccce52-dd80-4807-9dcf-59adbfcb4d52 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:14.724500 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-55ccce52-dd80-4807-9dcf-59adbfcb4d52 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:15.047832 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-55ccce52-dd80-4807-9dcf-59adbfcb4d52 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:15.056219 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-55ccce52-dd80-4807-9dcf-59adbfcb4d52 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1259 microversion: 2.1 time: 0.347364 Sep 16 08:15:15.056793 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 608/1163] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:14 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1259 bytes in 349 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:16.078985 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-91250637-90b1-4004-b34c-0df957b829b0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:16.079656 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-91250637-90b1-4004-b34c-0df957b829b0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:16.082633 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:16.086935 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-91250637-90b1-4004-b34c-0df957b829b0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:16.092246 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-91250637-90b1-4004-b34c-0df957b829b0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:16.092246 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-91250637-90b1-4004-b34c-0df957b829b0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:16.092246 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-91250637-90b1-4004-b34c-0df957b829b0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:16.092246 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-91250637-90b1-4004-b34c-0df957b829b0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:16.092973 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-91250637-90b1-4004-b34c-0df957b829b0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:16.251785 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-91250637-90b1-4004-b34c-0df957b829b0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:16.259697 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-91250637-90b1-4004-b34c-0df957b829b0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1259 microversion: 2.1 time: 0.184614 Sep 16 08:15:16.260271 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 556/1164] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:16 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1259 bytes in 186 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:17.281704 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a4dc4a14-816c-4430-acc0-a1e094d01518 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:17.282326 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a4dc4a14-816c-4430-acc0-a1e094d01518 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:17.288810 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a4dc4a14-816c-4430-acc0-a1e094d01518 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:17.289302 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a4dc4a14-816c-4430-acc0-a1e094d01518 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:17.289746 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a4dc4a14-816c-4430-acc0-a1e094d01518 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:17.290448 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a4dc4a14-816c-4430-acc0-a1e094d01518 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:17.290940 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a4dc4a14-816c-4430-acc0-a1e094d01518 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:17.291377 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a4dc4a14-816c-4430-acc0-a1e094d01518 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:17.432324 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a4dc4a14-816c-4430-acc0-a1e094d01518 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:17.441001 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a4dc4a14-816c-4430-acc0-a1e094d01518 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1259 microversion: 2.1 time: 0.163199 Sep 16 08:15:17.441575 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 609/1165] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:17 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1259 bytes in 164 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:18.466871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-ef05eeb0-711f-4dd7-a9ce-125ad1beaed9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:18.467490 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-ef05eeb0-711f-4dd7-a9ce-125ad1beaed9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:18.473955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ef05eeb0-711f-4dd7-a9ce-125ad1beaed9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:18.474430 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ef05eeb0-711f-4dd7-a9ce-125ad1beaed9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:18.474897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ef05eeb0-711f-4dd7-a9ce-125ad1beaed9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:18.475587 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ef05eeb0-711f-4dd7-a9ce-125ad1beaed9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:18.476039 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ef05eeb0-711f-4dd7-a9ce-125ad1beaed9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:18.476461 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-ef05eeb0-711f-4dd7-a9ce-125ad1beaed9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:18.789338 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-ef05eeb0-711f-4dd7-a9ce-125ad1beaed9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:18.796996 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-ef05eeb0-711f-4dd7-a9ce-125ad1beaed9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1259 microversion: 2.1 time: 0.334155 Sep 16 08:15:18.797564 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 557/1166] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:18 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1259 bytes in 335 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:19.520717 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-db72bce1-8f0e-49f9-aba9-c341332cb7a5 req-26584e90-9da5-4bdd-b171-49ee27109d1b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747eb003-d2cb-4458-9c34-b5f64b8ac764", "name": "network-vif-plugged", "status": "completed", "tag": "ffe6532b-6bcb-4c4c-a9aa-8071554bec05"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:15:19.531252 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-db72bce1-8f0e-49f9-aba9-c341332cb7a5 req-26584e90-9da5-4bdd-b171-49ee27109d1b service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:19.531764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-db72bce1-8f0e-49f9-aba9-c341332cb7a5 req-26584e90-9da5-4bdd-b171-49ee27109d1b service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:19.532251 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-db72bce1-8f0e-49f9-aba9-c341332cb7a5 req-26584e90-9da5-4bdd-b171-49ee27109d1b service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:19.545154 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-db72bce1-8f0e-49f9-aba9-c341332cb7a5 req-26584e90-9da5-4bdd-b171-49ee27109d1b service nova] Creating event network-vif-plugged:ffe6532b-6bcb-4c4c-a9aa-8071554bec05 for instance 747eb003-d2cb-4458-9c34-b5f64b8ac764 on hv-cinder-74014 Sep 16 08:15:19.550816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-db72bce1-8f0e-49f9-aba9-c341332cb7a5 req-26584e90-9da5-4bdd-b171-49ee27109d1b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.034177 Sep 16 08:15:19.551256 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 610/1167] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:15:19 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 36 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:15:19.820983 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-7cdb3ca9-3b82-4696-bf37-5faf1b3c00c1 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:19.821859 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-7cdb3ca9-3b82-4696-bf37-5faf1b3c00c1 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:19.828137 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7cdb3ca9-3b82-4696-bf37-5faf1b3c00c1 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:19.828918 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7cdb3ca9-3b82-4696-bf37-5faf1b3c00c1 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:19.829357 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7cdb3ca9-3b82-4696-bf37-5faf1b3c00c1 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:19.830063 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7cdb3ca9-3b82-4696-bf37-5faf1b3c00c1 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:19.830544 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7cdb3ca9-3b82-4696-bf37-5faf1b3c00c1 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:19.831024 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-7cdb3ca9-3b82-4696-bf37-5faf1b3c00c1 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:19.965792 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-7cdb3ca9-3b82-4696-bf37-5faf1b3c00c1 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:19.976571 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-7cdb3ca9-3b82-4696-bf37-5faf1b3c00c1 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1259 microversion: 2.1 time: 0.159550 Sep 16 08:15:19.977342 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 558/1168] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:19 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1259 bytes in 161 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:21.000770 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-acbbcd42-79e3-4625-a34c-390c71f4cdec tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:21.001474 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-acbbcd42-79e3-4625-a34c-390c71f4cdec tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:21.008081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-acbbcd42-79e3-4625-a34c-390c71f4cdec tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:21.008573 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-acbbcd42-79e3-4625-a34c-390c71f4cdec tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:21.009011 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-acbbcd42-79e3-4625-a34c-390c71f4cdec tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:21.009703 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-acbbcd42-79e3-4625-a34c-390c71f4cdec tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:21.010162 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-acbbcd42-79e3-4625-a34c-390c71f4cdec tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:21.010588 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-acbbcd42-79e3-4625-a34c-390c71f4cdec tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:21.143490 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-acbbcd42-79e3-4625-a34c-390c71f4cdec tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:21.151583 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-acbbcd42-79e3-4625-a34c-390c71f4cdec tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1259 microversion: 2.1 time: 0.155258 Sep 16 08:15:21.152152 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 611/1169] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:20 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1259 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:22.174513 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9972e44b-9b1b-4bc0-a96f-84ba3cec0057 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:22.175157 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9972e44b-9b1b-4bc0-a96f-84ba3cec0057 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:22.181527 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9972e44b-9b1b-4bc0-a96f-84ba3cec0057 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:22.182005 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9972e44b-9b1b-4bc0-a96f-84ba3cec0057 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:22.182433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9972e44b-9b1b-4bc0-a96f-84ba3cec0057 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:22.183147 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9972e44b-9b1b-4bc0-a96f-84ba3cec0057 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:22.183597 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9972e44b-9b1b-4bc0-a96f-84ba3cec0057 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:22.184023 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9972e44b-9b1b-4bc0-a96f-84ba3cec0057 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:22.309914 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9972e44b-9b1b-4bc0-a96f-84ba3cec0057 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:22.318235 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9972e44b-9b1b-4bc0-a96f-84ba3cec0057 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1259 microversion: 2.1 time: 0.147578 Sep 16 08:15:22.318831 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 559/1170] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:22 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:23.340501 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f80bfc54-2059-4931-988d-9b9fc9e84e53 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:23.341119 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f80bfc54-2059-4931-988d-9b9fc9e84e53 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:23.348200 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f80bfc54-2059-4931-988d-9b9fc9e84e53 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:23.348685 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f80bfc54-2059-4931-988d-9b9fc9e84e53 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:23.349122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f80bfc54-2059-4931-988d-9b9fc9e84e53 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:23.349816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f80bfc54-2059-4931-988d-9b9fc9e84e53 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:23.350278 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f80bfc54-2059-4931-988d-9b9fc9e84e53 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:23.350724 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f80bfc54-2059-4931-988d-9b9fc9e84e53 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:23.477165 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f80bfc54-2059-4931-988d-9b9fc9e84e53 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:23.484732 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f80bfc54-2059-4931-988d-9b9fc9e84e53 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1259 microversion: 2.1 time: 0.148157 Sep 16 08:15:23.485287 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 612/1171] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:23 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1259 bytes in 149 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:24.508211 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-23c31911-9ef4-4d53-b80a-fc447b0bb4cb tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:24.508861 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-23c31911-9ef4-4d53-b80a-fc447b0bb4cb tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:24.515437 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-23c31911-9ef4-4d53-b80a-fc447b0bb4cb tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:24.516032 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-23c31911-9ef4-4d53-b80a-fc447b0bb4cb tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:24.516468 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-23c31911-9ef4-4d53-b80a-fc447b0bb4cb tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:24.517160 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-23c31911-9ef4-4d53-b80a-fc447b0bb4cb tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:24.517693 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-23c31911-9ef4-4d53-b80a-fc447b0bb4cb tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:24.518157 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-23c31911-9ef4-4d53-b80a-fc447b0bb4cb tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:24.659658 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-23c31911-9ef4-4d53-b80a-fc447b0bb4cb tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:24.667658 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-23c31911-9ef4-4d53-b80a-fc447b0bb4cb tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1443 microversion: 2.1 time: 0.164232 Sep 16 08:15:24.668236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 560/1172] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:24 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1443 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:24.690203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-cf8c037f-703b-4fba-88b3-58a45f461575 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:24.690844 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-cf8c037f-703b-4fba-88b3-58a45f461575 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:24.697144 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf8c037f-703b-4fba-88b3-58a45f461575 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:24.697732 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf8c037f-703b-4fba-88b3-58a45f461575 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:24.698113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf8c037f-703b-4fba-88b3-58a45f461575 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:24.698842 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf8c037f-703b-4fba-88b3-58a45f461575 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:24.699298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf8c037f-703b-4fba-88b3-58a45f461575 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:24.699984 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-cf8c037f-703b-4fba-88b3-58a45f461575 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:24.835309 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-cf8c037f-703b-4fba-88b3-58a45f461575 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:24.843170 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-cf8c037f-703b-4fba-88b3-58a45f461575 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1443 microversion: 2.1 time: 0.156744 Sep 16 08:15:24.843770 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 613/1173] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:24 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1443 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:26.864661 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-44abce74-5f6a-4214-9d8e-a494e315fcdd req-b220d880-7a49-4242-bcc0-7d4c573ec9ab service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "747eb003-d2cb-4458-9c34-b5f64b8ac764", "tag": "ffe6532b-6bcb-4c4c-a9aa-8071554bec05"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:15:26.874827 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-44abce74-5f6a-4214-9d8e-a494e315fcdd req-b220d880-7a49-4242-bcc0-7d4c573ec9ab service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:26.875333 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-44abce74-5f6a-4214-9d8e-a494e315fcdd req-b220d880-7a49-4242-bcc0-7d4c573ec9ab service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:26.875771 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-44abce74-5f6a-4214-9d8e-a494e315fcdd req-b220d880-7a49-4242-bcc0-7d4c573ec9ab service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:26.887035 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-44abce74-5f6a-4214-9d8e-a494e315fcdd req-b220d880-7a49-4242-bcc0-7d4c573ec9ab service nova] Creating event network-changed:ffe6532b-6bcb-4c4c-a9aa-8071554bec05 for instance 747eb003-d2cb-4458-9c34-b5f64b8ac764 on hv-cinder-74014 Sep 16 08:15:26.892058 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-44abce74-5f6a-4214-9d8e-a494e315fcdd req-b220d880-7a49-4242-bcc0-7d4c573ec9ab service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.031327 Sep 16 08:15:26.892730 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 561/1174] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:15:26 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 33 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:15:34.035319 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Action: 'create', calling method: >, body: {"server": {"name": "tempest-VolumesNegativeTest-instance-1110788050", "imageRef": "f60c4dfb-0887-44c6-bb1d-51821eaf7d73", "flavorRef": "452"}} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:15:34.043220 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 08:15:34.044172 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Fri Sep 16 08:15:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers (ip 10.222.0.59) !!! Sep 16 08:15:34.044642 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=51,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:34.097253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.network.neutron [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] validate_networks() for None {{(pid=121046) validate_networks /opt/stack/nova/nova/network/neutron.py:2623}} Sep 16 08:15:34.366366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Flavor limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:343}} Sep 16 08:15:34.366820 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Image limits 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:347}} Sep 16 08:15:34.367299 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Flavor pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:383}} Sep 16 08:15:34.367710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Image pref 0:0:0 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:387}} Sep 16 08:15:34.368155 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.virt.hardware [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Chose sockets=0, cores=0, threads=0; limits were sockets=65536, cores=65536, threads=65536 {{(pid=121046) get_cpu_topology_constraints /opt/stack/nova/nova/virt/hardware.py:425}} Sep 16 08:15:34.376864 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "00000000-0000-0000-0000-000000000000" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:34.377410 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "00000000-0000-0000-0000-000000000000" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:34.377848 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "00000000-0000-0000-0000-000000000000" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:34.378570 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:34.379054 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:34.379481 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:34.386553 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=89,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:34.397050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Getting quotas for project 189501ce59cd40bcbdf98964e256838f. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:393}} Sep 16 08:15:34.401198 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.quota [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Getting quotas for user 012986457f7f42b295a3bca580bb7303 and project 189501ce59cd40bcbdf98964e256838f. Resources: {'cores', 'ram', 'instances'} {{(pid=121046) _get_quotas /opt/stack/nova/nova/quota.py:383}} Sep 16 08:15:34.412198 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Going to run 1 instances... {{(pid=121046) _provision_instances /opt/stack/nova/nova/compute/api.py:1403}} Sep 16 08:15:34.414446 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] block_device_mapping [BlockDeviceMapping(attachment_id=,boot_index=0,connection_info=None,created_at=,delete_on_termination=True,deleted=,deleted_at=,destination_type='local',device_name=None,device_type='disk',disk_bus=None,encrypted=False,encryption_format=None,encryption_options=None,encryption_secret_uuid=None,guest_format=None,id=,image_id='f60c4dfb-0887-44c6-bb1d-51821eaf7d73',instance=,instance_uuid=,no_device=False,snapshot_id=None,source_type='image',tag=None,updated_at=,uuid=,volume_id=None,volume_size=None,volume_type=None)] {{(pid=121046) _bdm_validate_set_size_and_instance /opt/stack/nova/nova/compute/api.py:1864}} Sep 16 08:15:34.552681 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-4ecd3aca-98fc-4220-ae26-2e56c9ccc858 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "POST /compute/v2.1/servers" status: 202 len: 380 microversion: 2.1 time: 0.521464 Sep 16 08:15:34.553332 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 614/1175] 10.222.0.59 () {60 vars in 1147 bytes} [Fri Sep 16 08:15:34 2022] POST /compute/v2.1/servers => generated 380 bytes in 523 msecs (HTTP/1.1 202) 10 headers in 451 bytes (1 switches on core 0) Sep 16 08:15:34.562832 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 08:15:34.563435 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Fri Sep 16 08:15:34 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 (ip 10.222.0.59) !!! Sep 16 08:15:34.570070 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-60f78a00-e169-498e-9fde-1cd3a50f7634 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:34.570728 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-60f78a00-e169-498e-9fde-1cd3a50f7634 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:34.578492 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=35 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:34.633138 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-60f78a00-e169-498e-9fde-1cd3a50f7634 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:34.640710 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-60f78a00-e169-498e-9fde-1cd3a50f7634 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1215 microversion: 2.1 time: 0.079875 Sep 16 08:15:34.641267 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 562/1176] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:34 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1215 bytes in 81 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:35.672575 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3a937dff-d56b-47e7-b089-1a2a1699e2e9 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:35.673429 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3a937dff-d56b-47e7-b089-1a2a1699e2e9 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:35.682980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a937dff-d56b-47e7-b089-1a2a1699e2e9 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:35.687253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a937dff-d56b-47e7-b089-1a2a1699e2e9 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:35.687973 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a937dff-d56b-47e7-b089-1a2a1699e2e9 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.004s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:35.689063 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a937dff-d56b-47e7-b089-1a2a1699e2e9 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:35.689733 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a937dff-d56b-47e7-b089-1a2a1699e2e9 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:35.690546 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3a937dff-d56b-47e7-b089-1a2a1699e2e9 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:35.770668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-3a937dff-d56b-47e7-b089-1a2a1699e2e9 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:35.781158 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3a937dff-d56b-47e7-b089-1a2a1699e2e9 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1219 microversion: 2.1 time: 0.118114 Sep 16 08:15:35.781731 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 615/1177] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:35 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1219 bytes in 122 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:36.804611 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-64b0902f-f99a-4bc7-804a-40076ee82fa7 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:36.805223 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-64b0902f-f99a-4bc7-804a-40076ee82fa7 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:36.812151 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-64b0902f-f99a-4bc7-804a-40076ee82fa7 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:36.812630 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-64b0902f-f99a-4bc7-804a-40076ee82fa7 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:36.813063 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-64b0902f-f99a-4bc7-804a-40076ee82fa7 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:36.813809 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-64b0902f-f99a-4bc7-804a-40076ee82fa7 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:36.814337 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-64b0902f-f99a-4bc7-804a-40076ee82fa7 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:36.814785 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-64b0902f-f99a-4bc7-804a-40076ee82fa7 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:36.819791 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=82,nova_cell1:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:36.876916 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-64b0902f-f99a-4bc7-804a-40076ee82fa7 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:36.885115 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-64b0902f-f99a-4bc7-804a-40076ee82fa7 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1267 microversion: 2.1 time: 0.084849 Sep 16 08:15:36.885715 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 563/1178] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:36 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1267 bytes in 86 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:37.909116 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-481515ec-8449-4b65-9c60-33bb419a32ac tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:37.909847 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-481515ec-8449-4b65-9c60-33bb419a32ac tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:37.919456 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-481515ec-8449-4b65-9c60-33bb419a32ac tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:37.920160 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-481515ec-8449-4b65-9c60-33bb419a32ac tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:37.921540 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-481515ec-8449-4b65-9c60-33bb419a32ac tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:37.922663 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-481515ec-8449-4b65-9c60-33bb419a32ac tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:37.923297 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-481515ec-8449-4b65-9c60-33bb419a32ac tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:37.923831 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-481515ec-8449-4b65-9c60-33bb419a32ac tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:38.134846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-481515ec-8449-4b65-9c60-33bb419a32ac tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:38.142617 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-481515ec-8449-4b65-9c60-33bb419a32ac tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1273 microversion: 2.1 time: 0.238351 Sep 16 08:15:38.143301 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 616/1179] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:37 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1273 bytes in 240 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:39.167322 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6d109611-3600-45a4-be30-f0fa6d0cd8b4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:39.168491 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6d109611-3600-45a4-be30-f0fa6d0cd8b4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:39.175386 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6d109611-3600-45a4-be30-f0fa6d0cd8b4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:39.175834 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6d109611-3600-45a4-be30-f0fa6d0cd8b4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:39.176274 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6d109611-3600-45a4-be30-f0fa6d0cd8b4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:39.176972 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6d109611-3600-45a4-be30-f0fa6d0cd8b4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:39.177423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6d109611-3600-45a4-be30-f0fa6d0cd8b4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:39.177848 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6d109611-3600-45a4-be30-f0fa6d0cd8b4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:39.301019 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-0f49437b-f335-4f5b-98e2-93dee8530567 req-0f6613ac-5385-45c6-a82b-dd6104732bc4 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "54c9c15d-2a10-40aa-853f-f67e072cb4f2", "tag": "4c71af95-db77-41b0-98dc-6563d326504f"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:15:39.306400 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6d109611-3600-45a4-be30-f0fa6d0cd8b4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:39.313496 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-0f49437b-f335-4f5b-98e2-93dee8530567 req-0f6613ac-5385-45c6-a82b-dd6104732bc4 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:39.314212 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-0f49437b-f335-4f5b-98e2-93dee8530567 req-0f6613ac-5385-45c6-a82b-dd6104732bc4 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:39.315413 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-0f49437b-f335-4f5b-98e2-93dee8530567 req-0f6613ac-5385-45c6-a82b-dd6104732bc4 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:39.315570 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6d109611-3600-45a4-be30-f0fa6d0cd8b4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1315 microversion: 2.1 time: 0.152040 Sep 16 08:15:39.316297 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 564/1180] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:39 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:39.326080 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-0f49437b-f335-4f5b-98e2-93dee8530567 req-0f6613ac-5385-45c6-a82b-dd6104732bc4 service nova] Creating event network-changed:4c71af95-db77-41b0-98dc-6563d326504f for instance 54c9c15d-2a10-40aa-853f-f67e072cb4f2 on hv-cinder-74014 Sep 16 08:15:39.334900 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-0f49437b-f335-4f5b-98e2-93dee8530567 req-0f6613ac-5385-45c6-a82b-dd6104732bc4 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.037809 Sep 16 08:15:39.335381 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 617/1181] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:15:39 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 39 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:15:40.339972 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9478f704-ba66-4b29-aff6-a9e8b5cdeb1a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:40.340578 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9478f704-ba66-4b29-aff6-a9e8b5cdeb1a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:40.347094 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9478f704-ba66-4b29-aff6-a9e8b5cdeb1a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:40.350352 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9478f704-ba66-4b29-aff6-a9e8b5cdeb1a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:40.350352 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9478f704-ba66-4b29-aff6-a9e8b5cdeb1a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:40.350352 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9478f704-ba66-4b29-aff6-a9e8b5cdeb1a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:40.350352 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9478f704-ba66-4b29-aff6-a9e8b5cdeb1a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:40.350770 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9478f704-ba66-4b29-aff6-a9e8b5cdeb1a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:40.477593 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9478f704-ba66-4b29-aff6-a9e8b5cdeb1a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:40.485244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9478f704-ba66-4b29-aff6-a9e8b5cdeb1a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1315 microversion: 2.1 time: 0.149342 Sep 16 08:15:40.485748 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 565/1182] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:40 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:15:41.509007 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-614fe334-8d28-4704-a53d-8db5b128df46 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:41.509742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-614fe334-8d28-4704-a53d-8db5b128df46 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:41.515823 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-614fe334-8d28-4704-a53d-8db5b128df46 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:41.516311 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-614fe334-8d28-4704-a53d-8db5b128df46 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:41.516752 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-614fe334-8d28-4704-a53d-8db5b128df46 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:41.517489 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-614fe334-8d28-4704-a53d-8db5b128df46 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:41.517898 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-614fe334-8d28-4704-a53d-8db5b128df46 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:41.518332 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-614fe334-8d28-4704-a53d-8db5b128df46 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:41.648285 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-614fe334-8d28-4704-a53d-8db5b128df46 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:41.656747 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-614fe334-8d28-4704-a53d-8db5b128df46 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1315 microversion: 2.1 time: 0.152559 Sep 16 08:15:41.657313 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 618/1183] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:41 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:42.679714 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c69530a4-733d-45a6-abea-fea55a850585 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:42.680333 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c69530a4-733d-45a6-abea-fea55a850585 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:42.686579 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c69530a4-733d-45a6-abea-fea55a850585 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:42.687101 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c69530a4-733d-45a6-abea-fea55a850585 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:42.687545 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c69530a4-733d-45a6-abea-fea55a850585 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:42.688246 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c69530a4-733d-45a6-abea-fea55a850585 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:42.688704 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c69530a4-733d-45a6-abea-fea55a850585 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:42.689139 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c69530a4-733d-45a6-abea-fea55a850585 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:42.817354 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c69530a4-733d-45a6-abea-fea55a850585 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:42.825055 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c69530a4-733d-45a6-abea-fea55a850585 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1315 microversion: 2.1 time: 0.149335 Sep 16 08:15:42.825653 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 566/1184] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:42 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1315 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:43.848181 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a8ede65a-fea5-4982-9507-091f81799596 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:43.848804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a8ede65a-fea5-4982-9507-091f81799596 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:43.855173 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a8ede65a-fea5-4982-9507-091f81799596 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:43.855661 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a8ede65a-fea5-4982-9507-091f81799596 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:43.856105 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a8ede65a-fea5-4982-9507-091f81799596 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:43.856801 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a8ede65a-fea5-4982-9507-091f81799596 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:43.857265 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a8ede65a-fea5-4982-9507-091f81799596 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:43.857692 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a8ede65a-fea5-4982-9507-091f81799596 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:43.984815 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a8ede65a-fea5-4982-9507-091f81799596 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:43.992649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a8ede65a-fea5-4982-9507-091f81799596 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1315 microversion: 2.1 time: 0.149080 Sep 16 08:15:43.993223 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 619/1185] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:43 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1315 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:45.015764 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e11612c1-448b-4dff-ab8e-ba76cbf89083 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:45.016374 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e11612c1-448b-4dff-ab8e-ba76cbf89083 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:45.018875 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell0:SELECT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:45.024101 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e11612c1-448b-4dff-ab8e-ba76cbf89083 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:45.024580 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e11612c1-448b-4dff-ab8e-ba76cbf89083 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:45.025016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e11612c1-448b-4dff-ab8e-ba76cbf89083 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:45.025971 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e11612c1-448b-4dff-ab8e-ba76cbf89083 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:45.026421 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e11612c1-448b-4dff-ab8e-ba76cbf89083 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:45.026874 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e11612c1-448b-4dff-ab8e-ba76cbf89083 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:45.154818 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e11612c1-448b-4dff-ab8e-ba76cbf89083 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:45.163137 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e11612c1-448b-4dff-ab8e-ba76cbf89083 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1315 microversion: 2.1 time: 0.151265 Sep 16 08:15:45.163711 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 567/1186] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:45 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1315 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:46.185439 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5a2b6591-044f-410b-96cc-736a22fa254d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:46.186053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5a2b6591-044f-410b-96cc-736a22fa254d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:46.188047 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=2 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:46.188728 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell0:SELECT=6 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:15:46.194460 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5a2b6591-044f-410b-96cc-736a22fa254d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:46.195439 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5a2b6591-044f-410b-96cc-736a22fa254d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:46.195439 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5a2b6591-044f-410b-96cc-736a22fa254d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:46.196079 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5a2b6591-044f-410b-96cc-736a22fa254d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:46.196535 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5a2b6591-044f-410b-96cc-736a22fa254d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:46.196959 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5a2b6591-044f-410b-96cc-736a22fa254d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:46.327544 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-5a2b6591-044f-410b-96cc-736a22fa254d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:46.335754 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5a2b6591-044f-410b-96cc-736a22fa254d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1315 microversion: 2.1 time: 0.154256 Sep 16 08:15:46.336388 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 620/1187] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:46 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1315 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:47.359432 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-e3276d2f-e712-47b1-bb6a-642b2b2e10af tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:47.360044 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-e3276d2f-e712-47b1-bb6a-642b2b2e10af tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:47.366826 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e3276d2f-e712-47b1-bb6a-642b2b2e10af tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:47.367363 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e3276d2f-e712-47b1-bb6a-642b2b2e10af tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:47.367745 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e3276d2f-e712-47b1-bb6a-642b2b2e10af tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:47.368467 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e3276d2f-e712-47b1-bb6a-642b2b2e10af tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:47.368926 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e3276d2f-e712-47b1-bb6a-642b2b2e10af tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:47.369353 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-e3276d2f-e712-47b1-bb6a-642b2b2e10af tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:47.545037 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-e3276d2f-e712-47b1-bb6a-642b2b2e10af tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:47.552512 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-e3276d2f-e712-47b1-bb6a-642b2b2e10af tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1315 microversion: 2.1 time: 0.197056 Sep 16 08:15:47.556194 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 568/1188] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:47 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1315 bytes in 199 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:47.706287 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-73945ede-ce5c-4429-8787-6056e40a1691 req-9527fbfb-0698-41ae-81d0-faa1846d223a service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c9c15d-2a10-40aa-853f-f67e072cb4f2", "name": "network-vif-plugged", "status": "completed", "tag": "4c71af95-db77-41b0-98dc-6563d326504f"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:15:47.727649 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-73945ede-ce5c-4429-8787-6056e40a1691 req-9527fbfb-0698-41ae-81d0-faa1846d223a service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:47.728123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-73945ede-ce5c-4429-8787-6056e40a1691 req-9527fbfb-0698-41ae-81d0-faa1846d223a service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:47.728597 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-73945ede-ce5c-4429-8787-6056e40a1691 req-9527fbfb-0698-41ae-81d0-faa1846d223a service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:47.741285 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-73945ede-ce5c-4429-8787-6056e40a1691 req-9527fbfb-0698-41ae-81d0-faa1846d223a service nova] Creating event network-vif-plugged:4c71af95-db77-41b0-98dc-6563d326504f for instance 54c9c15d-2a10-40aa-853f-f67e072cb4f2 on hv-cinder-74014 Sep 16 08:15:47.746858 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-73945ede-ce5c-4429-8787-6056e40a1691 req-9527fbfb-0698-41ae-81d0-faa1846d223a service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.050513 Sep 16 08:15:47.747803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 621/1189] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:15:47 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 53 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:15:48.575467 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-72cad77d-3319-41e7-a947-b236c9b24f03 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:48.576078 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-72cad77d-3319-41e7-a947-b236c9b24f03 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:48.582427 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72cad77d-3319-41e7-a947-b236c9b24f03 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:48.583513 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72cad77d-3319-41e7-a947-b236c9b24f03 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:48.583947 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72cad77d-3319-41e7-a947-b236c9b24f03 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:48.584631 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72cad77d-3319-41e7-a947-b236c9b24f03 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:48.585088 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72cad77d-3319-41e7-a947-b236c9b24f03 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:48.585514 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-72cad77d-3319-41e7-a947-b236c9b24f03 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:48.709687 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-72cad77d-3319-41e7-a947-b236c9b24f03 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:48.717244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-72cad77d-3319-41e7-a947-b236c9b24f03 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1315 microversion: 2.1 time: 0.145641 Sep 16 08:15:48.717806 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 569/1190] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:48 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1315 bytes in 147 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:49.740624 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-f5e3a7a5-61bc-41f2-8006-5c4e9e6bf935 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:49.741331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-f5e3a7a5-61bc-41f2-8006-5c4e9e6bf935 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:49.748116 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5e3a7a5-61bc-41f2-8006-5c4e9e6bf935 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:49.748606 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5e3a7a5-61bc-41f2-8006-5c4e9e6bf935 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:49.749053 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5e3a7a5-61bc-41f2-8006-5c4e9e6bf935 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:49.749788 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5e3a7a5-61bc-41f2-8006-5c4e9e6bf935 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:49.750251 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5e3a7a5-61bc-41f2-8006-5c4e9e6bf935 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:49.750759 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-f5e3a7a5-61bc-41f2-8006-5c4e9e6bf935 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:49.880310 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-f5e3a7a5-61bc-41f2-8006-5c4e9e6bf935 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:49.888122 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-f5e3a7a5-61bc-41f2-8006-5c4e9e6bf935 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1315 microversion: 2.1 time: 0.152350 Sep 16 08:15:49.891366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 622/1191] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:49 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1315 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:50.911545 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d56f3944-1237-407e-9f83-d0ce0cc5ea12 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:50.912077 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d56f3944-1237-407e-9f83-d0ce0cc5ea12 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:50.918467 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d56f3944-1237-407e-9f83-d0ce0cc5ea12 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:50.918991 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d56f3944-1237-407e-9f83-d0ce0cc5ea12 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:50.919439 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d56f3944-1237-407e-9f83-d0ce0cc5ea12 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:50.920266 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d56f3944-1237-407e-9f83-d0ce0cc5ea12 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:50.920728 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d56f3944-1237-407e-9f83-d0ce0cc5ea12 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:50.921162 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d56f3944-1237-407e-9f83-d0ce0cc5ea12 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:51.048389 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d56f3944-1237-407e-9f83-d0ce0cc5ea12 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:51.056572 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d56f3944-1237-407e-9f83-d0ce0cc5ea12 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1464 microversion: 2.1 time: 0.149088 Sep 16 08:15:51.057145 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 570/1192] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:50 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1464 bytes in 150 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:51.102756 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5edaad73-73cf-4d7c-b2c6-afdd388e7916 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:51.103304 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5edaad73-73cf-4d7c-b2c6-afdd388e7916 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:51.109609 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5edaad73-73cf-4d7c-b2c6-afdd388e7916 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:51.110104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5edaad73-73cf-4d7c-b2c6-afdd388e7916 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:51.110527 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5edaad73-73cf-4d7c-b2c6-afdd388e7916 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:51.111253 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5edaad73-73cf-4d7c-b2c6-afdd388e7916 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:51.111713 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5edaad73-73cf-4d7c-b2c6-afdd388e7916 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:51.112140 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5edaad73-73cf-4d7c-b2c6-afdd388e7916 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:51.140095 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5edaad73-73cf-4d7c-b2c6-afdd388e7916 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:15:51.215822 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-31bd972b-d40c-43b0-be6d-c880c39c723d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:51.216324 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-31bd972b-d40c-43b0-be6d-c880c39c723d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:51.222347 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-31bd972b-d40c-43b0-be6d-c880c39c723d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:51.222868 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-31bd972b-d40c-43b0-be6d-c880c39c723d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:51.225929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-31bd972b-d40c-43b0-be6d-c880c39c723d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:51.225929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-31bd972b-d40c-43b0-be6d-c880c39c723d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:51.225929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-31bd972b-d40c-43b0-be6d-c880c39c723d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:51.225929 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-31bd972b-d40c-43b0-be6d-c880c39c723d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:51.251819 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-31bd972b-d40c-43b0-be6d-c880c39c723d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Going to try to terminate instance {{(pid=121047) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:15:51.362910 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5edaad73-73cf-4d7c-b2c6-afdd388e7916 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "DELETE /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 204 len: 0 microversion: 2.1 time: 0.263810 Sep 16 08:15:51.363655 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 623/1193] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:15:51 2022] DELETE /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 0 bytes in 265 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 08:15:51.371551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-13f4506e-2462-4b08-8c55-6f7a66d43a38 req-fa21c193-b07c-401d-adbe-72e1803b5c81 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "2e50a639-a343-4b0e-86fe-9dce43fcc147", "tag": "27297ab7-03c2-443e-8e58-5bfab33fa167"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:15:51.381077 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-13f4506e-2462-4b08-8c55-6f7a66d43a38 req-fa21c193-b07c-401d-adbe-72e1803b5c81 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:51.381317 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-13f4506e-2462-4b08-8c55-6f7a66d43a38 req-fa21c193-b07c-401d-adbe-72e1803b5c81 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:51.381759 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-13f4506e-2462-4b08-8c55-6f7a66d43a38 req-fa21c193-b07c-401d-adbe-72e1803b5c81 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:51.392944 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-13f4506e-2462-4b08-8c55-6f7a66d43a38 req-fa21c193-b07c-401d-adbe-72e1803b5c81 service nova] Creating event network-changed:27297ab7-03c2-443e-8e58-5bfab33fa167 for instance 2e50a639-a343-4b0e-86fe-9dce43fcc147 on hv-cinder-74014 Sep 16 08:15:51.397804 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-13f4506e-2462-4b08-8c55-6f7a66d43a38 req-fa21c193-b07c-401d-adbe-72e1803b5c81 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.032256 Sep 16 08:15:51.398395 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 624/1194] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:15:51 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:15:51.403619 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0eced49d-1876-401c-b3b0-af04e942df13 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:51.404322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0eced49d-1876-401c-b3b0-af04e942df13 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:51.410398 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0eced49d-1876-401c-b3b0-af04e942df13 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:51.411432 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0eced49d-1876-401c-b3b0-af04e942df13 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:51.411883 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0eced49d-1876-401c-b3b0-af04e942df13 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:51.412600 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0eced49d-1876-401c-b3b0-af04e942df13 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:51.413061 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0eced49d-1876-401c-b3b0-af04e942df13 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:51.413494 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0eced49d-1876-401c-b3b0-af04e942df13 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:51.477046 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-31bd972b-d40c-43b0-be6d-c880c39c723d tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "DELETE /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 204 len: 0 microversion: 2.1 time: 0.265003 Sep 16 08:15:51.477610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 571/1195] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:15:51 2022] DELETE /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 0 bytes in 267 msecs (HTTP/1.1 204) 9 headers in 363 bytes (2 switches on core 0) Sep 16 08:15:51.486159 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5c7d2c08-2ec2-4dc7-b9c5-8019489a2ab3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:51.489538 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5c7d2c08-2ec2-4dc7-b9c5-8019489a2ab3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:51.493466 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5c7d2c08-2ec2-4dc7-b9c5-8019489a2ab3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:51.494099 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5c7d2c08-2ec2-4dc7-b9c5-8019489a2ab3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:51.494830 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5c7d2c08-2ec2-4dc7-b9c5-8019489a2ab3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:51.495647 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5c7d2c08-2ec2-4dc7-b9c5-8019489a2ab3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:51.496181 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5c7d2c08-2ec2-4dc7-b9c5-8019489a2ab3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:51.496689 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5c7d2c08-2ec2-4dc7-b9c5-8019489a2ab3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:51.555483 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0eced49d-1876-401c-b3b0-af04e942df13 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:51.563781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0eced49d-1876-401c-b3b0-af04e942df13 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1470 microversion: 2.1 time: 0.164190 Sep 16 08:15:51.567722 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 625/1196] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:51 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1470 bytes in 166 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:51.645835 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5c7d2c08-2ec2-4dc7-b9c5-8019489a2ab3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:51.654125 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5c7d2c08-2ec2-4dc7-b9c5-8019489a2ab3 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1578 microversion: 2.1 time: 0.172179 Sep 16 08:15:51.654715 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 572/1197] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:51 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1578 bytes in 173 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:52.586913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dc13f830-30d4-47a5-b418-efac9a3f024f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:52.587490 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dc13f830-30d4-47a5-b418-efac9a3f024f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:52.593953 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc13f830-30d4-47a5-b418-efac9a3f024f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:52.594441 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc13f830-30d4-47a5-b418-efac9a3f024f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:52.594920 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc13f830-30d4-47a5-b418-efac9a3f024f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:52.595624 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc13f830-30d4-47a5-b418-efac9a3f024f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:52.596084 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc13f830-30d4-47a5-b418-efac9a3f024f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:52.596516 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dc13f830-30d4-47a5-b418-efac9a3f024f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:52.679385 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-22412b27-a6a8-4e20-af01-55f7db3d412e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:52.680106 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-22412b27-a6a8-4e20-af01-55f7db3d412e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:52.686651 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22412b27-a6a8-4e20-af01-55f7db3d412e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:52.687168 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22412b27-a6a8-4e20-af01-55f7db3d412e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:52.687609 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22412b27-a6a8-4e20-af01-55f7db3d412e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:52.688313 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22412b27-a6a8-4e20-af01-55f7db3d412e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:52.688771 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22412b27-a6a8-4e20-af01-55f7db3d412e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:52.689206 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-22412b27-a6a8-4e20-af01-55f7db3d412e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:52.755757 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dc13f830-30d4-47a5-b418-efac9a3f024f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:52.763996 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dc13f830-30d4-47a5-b418-efac9a3f024f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1470 microversion: 2.1 time: 0.181037 Sep 16 08:15:52.764576 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 626/1198] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:52 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1470 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:52.822500 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-22412b27-a6a8-4e20-af01-55f7db3d412e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:52.830200 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-22412b27-a6a8-4e20-af01-55f7db3d412e tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1578 microversion: 2.1 time: 0.155501 Sep 16 08:15:52.830783 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 573/1199] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:52 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1578 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:15:53.787728 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-20391c26-9397-457c-8be7-ef6318bda65a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:53.788343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-20391c26-9397-457c-8be7-ef6318bda65a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:53.794652 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-20391c26-9397-457c-8be7-ef6318bda65a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:53.795160 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-20391c26-9397-457c-8be7-ef6318bda65a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:53.795601 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-20391c26-9397-457c-8be7-ef6318bda65a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:53.796290 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-20391c26-9397-457c-8be7-ef6318bda65a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:53.796748 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-20391c26-9397-457c-8be7-ef6318bda65a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:53.797173 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-20391c26-9397-457c-8be7-ef6318bda65a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:53.853498 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-dcc7cab0-7883-4381-a6d1-b8e335fbe23c tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:53.854112 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-dcc7cab0-7883-4381-a6d1-b8e335fbe23c tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:53.860724 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dcc7cab0-7883-4381-a6d1-b8e335fbe23c tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:53.861298 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dcc7cab0-7883-4381-a6d1-b8e335fbe23c tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:53.861738 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dcc7cab0-7883-4381-a6d1-b8e335fbe23c tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:53.862568 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dcc7cab0-7883-4381-a6d1-b8e335fbe23c tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:53.863062 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dcc7cab0-7883-4381-a6d1-b8e335fbe23c tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:53.863496 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dcc7cab0-7883-4381-a6d1-b8e335fbe23c tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:53.929040 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-20391c26-9397-457c-8be7-ef6318bda65a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:53.936729 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-20391c26-9397-457c-8be7-ef6318bda65a tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1470 microversion: 2.1 time: 0.153427 Sep 16 08:15:53.937298 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 627/1200] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:53 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1470 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:53.994815 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dcc7cab0-7883-4381-a6d1-b8e335fbe23c tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:54.002521 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-dcc7cab0-7883-4381-a6d1-b8e335fbe23c tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1578 microversion: 2.1 time: 0.152957 Sep 16 08:15:54.003127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 574/1201] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:53 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1578 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:15:54.960335 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-74ec362d-2bd6-4c09-a443-6675aeb1da6d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:54.960958 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-74ec362d-2bd6-4c09-a443-6675aeb1da6d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:54.967577 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74ec362d-2bd6-4c09-a443-6675aeb1da6d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:54.968071 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74ec362d-2bd6-4c09-a443-6675aeb1da6d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:54.968515 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74ec362d-2bd6-4c09-a443-6675aeb1da6d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:54.969225 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74ec362d-2bd6-4c09-a443-6675aeb1da6d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:54.969702 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74ec362d-2bd6-4c09-a443-6675aeb1da6d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:54.973455 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-74ec362d-2bd6-4c09-a443-6675aeb1da6d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:55.027270 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-423079cb-0407-4e50-be67-d2f10ea345c2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:55.027991 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-423079cb-0407-4e50-be67-d2f10ea345c2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:55.036399 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-423079cb-0407-4e50-be67-d2f10ea345c2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:55.037811 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-423079cb-0407-4e50-be67-d2f10ea345c2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:55.038433 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-423079cb-0407-4e50-be67-d2f10ea345c2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:55.039532 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-423079cb-0407-4e50-be67-d2f10ea345c2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:55.040218 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-423079cb-0407-4e50-be67-d2f10ea345c2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:55.040822 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-423079cb-0407-4e50-be67-d2f10ea345c2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:55.060756 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-74ec362d-2bd6-4c09-a443-6675aeb1da6d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:55.075458 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-74ec362d-2bd6-4c09-a443-6675aeb1da6d tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1428 microversion: 2.1 time: 0.119167 Sep 16 08:15:55.077948 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 628/1202] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:54 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1428 bytes in 123 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:55.233279 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-233b22de-d1a8-4bf8-9ffb-3747d4000138 req-39ce8baa-7b92-4a3f-ad81-335370484f1c service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "54c9c15d-2a10-40aa-853f-f67e072cb4f2", "name": "network-vif-deleted", "tag": "4c71af95-db77-41b0-98dc-6563d326504f"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:15:55.246229 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-233b22de-d1a8-4bf8-9ffb-3747d4000138 req-39ce8baa-7b92-4a3f-ad81-335370484f1c service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:55.247115 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-233b22de-d1a8-4bf8-9ffb-3747d4000138 req-39ce8baa-7b92-4a3f-ad81-335370484f1c service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:55.247794 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-233b22de-d1a8-4bf8-9ffb-3747d4000138 req-39ce8baa-7b92-4a3f-ad81-335370484f1c service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:55.261047 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-233b22de-d1a8-4bf8-9ffb-3747d4000138 req-39ce8baa-7b92-4a3f-ad81-335370484f1c service nova] Creating event network-vif-deleted:4c71af95-db77-41b0-98dc-6563d326504f for instance 54c9c15d-2a10-40aa-853f-f67e072cb4f2 on hv-cinder-74014 Sep 16 08:15:55.266337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-233b22de-d1a8-4bf8-9ffb-3747d4000138 req-39ce8baa-7b92-4a3f-ad81-335370484f1c service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.180516 Sep 16 08:15:55.266911 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 629/1203] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:15:55 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 182 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:15:55.335480 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-423079cb-0407-4e50-be67-d2f10ea345c2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:55.344483 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-423079cb-0407-4e50-be67-d2f10ea345c2 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1578 microversion: 2.1 time: 0.322996 Sep 16 08:15:55.350566 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 575/1204] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:55 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1578 bytes in 330 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:15:56.108382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:56.108382 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:56.112858 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:56.113341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:56.113779 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:56.114491 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:56.114974 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:56.115399 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:56.149480 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:56.149960 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:56.150650 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:56.151111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lazy-loading 'fault' on Instance uuid 54c9c15d-2a10-40aa-853f-f67e072cb4f2 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:15:56.194868 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '012986457f7f42b295a3bca580bb7303', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '189501ce59cd40bcbdf98964e256838f', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:56.202622 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8fc2efee-2704-4ff6-bb7d-7891d4d90e5f tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 200 len: 1305 microversion: 2.1 time: 0.101623 Sep 16 08:15:56.208272 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 630/1205] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:56 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 1305 bytes in 103 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:56.368571 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-d66a4fa4-d63c-4116-b37a-9de160993054 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:56.369183 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-d66a4fa4-d63c-4116-b37a-9de160993054 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:56.375589 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d66a4fa4-d63c-4116-b37a-9de160993054 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:56.376076 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d66a4fa4-d63c-4116-b37a-9de160993054 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:56.376533 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d66a4fa4-d63c-4116-b37a-9de160993054 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:56.377209 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d66a4fa4-d63c-4116-b37a-9de160993054 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:56.377669 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d66a4fa4-d63c-4116-b37a-9de160993054 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:56.378098 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-d66a4fa4-d63c-4116-b37a-9de160993054 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:56.440276 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-d66a4fa4-d63c-4116-b37a-9de160993054 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:15:56.448553 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-d66a4fa4-d63c-4116-b37a-9de160993054 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 200 len: 1225 microversion: 2.1 time: 0.083748 Sep 16 08:15:56.449058 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 576/1206] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:56 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 1225 bytes in 85 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:15:57.227127 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3bfc012a-bf6d-438b-824b-c19d32adb0f4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:57.227740 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-3bfc012a-bf6d-438b-824b-c19d32adb0f4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] [instance: 54c9c15d-2a10-40aa-853f-f67e072cb4f2] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:57.233990 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bfc012a-bf6d-438b-824b-c19d32adb0f4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:57.234469 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bfc012a-bf6d-438b-824b-c19d32adb0f4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:57.234941 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bfc012a-bf6d-438b-824b-c19d32adb0f4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:57.235634 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bfc012a-bf6d-438b-824b-c19d32adb0f4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:57.236087 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bfc012a-bf6d-438b-824b-c19d32adb0f4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:57.236542 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-3bfc012a-bf6d-438b-824b-c19d32adb0f4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:57.249898 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-3bfc012a-bf6d-438b-824b-c19d32adb0f4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] HTTP exception thrown: Instance 54c9c15d-2a10-40aa-853f-f67e072cb4f2 could not be found. Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3bfc012a-bf6d-438b-824b-c19d32adb0f4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Request method failure captured: Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 HTTP/1.1 Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJDCkmMK9I1zcuTtR608veP1oN1uHCS35_IPWmvRQ4TTCbRYVvBFjrdESLkAsuDmdYmtUHa8M0U0ixK0RUxmVzqW8r463Wst7GX6e_NuXLwzVrLsd7rqqpoqYyHne7SRkztqkdvlYODxn4t1sHg6h7eqYliix5-3WPOIlrqPrXmwNCv0 Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 189501ce59cd40bcbdf98964e256838f Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-VolumesNegativeTest-997172255 Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:15:57.251564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:15:57.259049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/189501ce59cd40bcbdf98964e256838f"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/189501ce59cd40bcbdf98964e256838f"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_189501ce59cd40bcbdf98964e256838f", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/189501ce59cd40bcbdf98964e256838f"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:15:57.259049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-VolumesNegativeTest-997172255 Sep 16 08:15:57.259049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 189501ce59cd40bcbdf98964e256838f Sep 16 08:15:57.259049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-VolumesNegativeTest-997172255 Sep 16 08:15:57.259049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-VolumesNegativeTest-997172255-project Sep 16 08:15:57.259049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:15:57.259049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:15:57.259049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: 012986457f7f42b295a3bca580bb7303 Sep 16 08:15:57.259049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-VolumesNegativeTest-997172255-project Sep 16 08:15:57.259049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:15:57.259049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 54c9c15d-2a10-40aa-853f-f67e072cb4f2 could not be found. Sep 16 08:15:57.259049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '54c9c15d-2a10-40aa-853f-f67e072cb4f2'} Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 54c9c15d-2a10-40aa-853f-f67e072cb4f2 could not be found. Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:15:57.260289 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 54c9c15d-2a10-40aa-853f-f67e072cb4f2 could not be found. Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 54c9c15d-2a10-40aa-853f-f67e072cb4f2 could not be found. Sep 16 08:15:57.261894 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:57.264319 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-3bfc012a-bf6d-438b-824b-c19d32adb0f4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] Returning 404 to user: Instance 54c9c15d-2a10-40aa-853f-f67e072cb4f2 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:15:57.264319 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-3bfc012a-bf6d-438b-824b-c19d32adb0f4 tempest-VolumesNegativeTest-997172255 tempest-VolumesNegativeTest-997172255-project] 10.222.0.59 "GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2" status: 404 len: 111 microversion: 2.1 time: 0.030392 Sep 16 08:15:57.264319 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 631/1207] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:57 2022] GET /compute/v2.1/servers/54c9c15d-2a10-40aa-853f-f67e072cb4f2 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:15:57.282189 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-642033a0-14c2-4538-bcc8-94f8f6327031 req-26dbef08-8cc3-4681-a3f0-ea0978049207 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "2e50a639-a343-4b0e-86fe-9dce43fcc147", "name": "network-vif-deleted", "tag": "27297ab7-03c2-443e-8e58-5bfab33fa167"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:15:57.292453 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-642033a0-14c2-4538-bcc8-94f8f6327031 req-26dbef08-8cc3-4681-a3f0-ea0978049207 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:57.292934 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-642033a0-14c2-4538-bcc8-94f8f6327031 req-26dbef08-8cc3-4681-a3f0-ea0978049207 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:57.293372 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-642033a0-14c2-4538-bcc8-94f8f6327031 req-26dbef08-8cc3-4681-a3f0-ea0978049207 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:57.304016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-642033a0-14c2-4538-bcc8-94f8f6327031 req-26dbef08-8cc3-4681-a3f0-ea0978049207 service nova] Creating event network-vif-deleted:27297ab7-03c2-443e-8e58-5bfab33fa167 for instance 2e50a639-a343-4b0e-86fe-9dce43fcc147 on hv-cinder-74014 Sep 16 08:15:57.308897 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-642033a0-14c2-4538-bcc8-94f8f6327031 req-26dbef08-8cc3-4681-a3f0-ea0978049207 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030312 Sep 16 08:15:57.309461 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 577/1208] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:15:57 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:15:57.471774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5f14ee8b-5836-4e6f-968f-a3ee3a775a34 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:15:57.472383 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-5f14ee8b-5836-4e6f-968f-a3ee3a775a34 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: 2e50a639-a343-4b0e-86fe-9dce43fcc147] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:15:57.478408 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f14ee8b-5836-4e6f-968f-a3ee3a775a34 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:57.478935 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f14ee8b-5836-4e6f-968f-a3ee3a775a34 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:57.479386 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f14ee8b-5836-4e6f-968f-a3ee3a775a34 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:57.480123 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f14ee8b-5836-4e6f-968f-a3ee3a775a34 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:15:57.480585 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f14ee8b-5836-4e6f-968f-a3ee3a775a34 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:15:57.481020 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-5f14ee8b-5836-4e6f-968f-a3ee3a775a34 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:15:57.494784 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-5f14ee8b-5836-4e6f-968f-a3ee3a775a34 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] HTTP exception thrown: Instance 2e50a639-a343-4b0e-86fe-9dce43fcc147 could not be found. Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5f14ee8b-5836-4e6f-968f-a3ee3a775a34 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Request method failure captured: Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 HTTP/1.1 Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC7icc78RDqf1g0pn-txuagC1GTaL1aKZB7vktx-XG4uVN4TFTZJJbhJ2s0ZnCqlJ18WLQDJHcKLkofsjUo5J5n9INqsVZBriLM7wME2rxyErmH0YMVll4Vky1wePEf1bJcfZ1cWuQTQd2pVWc1fc3zBXCImrYy9GI2nQgVL9TPhptA Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 794ad972bfa844538f6f71d62e7bd163 Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-TestVolumeBootPattern-541351610 Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:15:57.496337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:15:57.498222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_794ad972bfa844538f6f71d62e7bd163", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:15:57.498222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-TestVolumeBootPattern-541351610 Sep 16 08:15:57.498222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 794ad972bfa844538f6f71d62e7bd163 Sep 16 08:15:57.498222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-TestVolumeBootPattern-541351610 Sep 16 08:15:57.498222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-TestVolumeBootPattern-541351610-project Sep 16 08:15:57.498222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:15:57.498222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:15:57.498222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: afbb1d9c9bb34fbd8bfc78710c86d1f5 Sep 16 08:15:57.498222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-TestVolumeBootPattern-541351610-project Sep 16 08:15:57.498222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:15:57.498222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 2e50a639-a343-4b0e-86fe-9dce43fcc147 could not be found. Sep 16 08:15:57.498222 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '2e50a639-a343-4b0e-86fe-9dce43fcc147'} Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 2e50a639-a343-4b0e-86fe-9dce43fcc147 could not be found. Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:15:57.499245 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 2e50a639-a343-4b0e-86fe-9dce43fcc147 could not be found. Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 2e50a639-a343-4b0e-86fe-9dce43fcc147 could not be found. Sep 16 08:15:57.500857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:15:57.502331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-5f14ee8b-5836-4e6f-968f-a3ee3a775a34 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Returning 404 to user: Instance 2e50a639-a343-4b0e-86fe-9dce43fcc147 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:15:57.502331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-5f14ee8b-5836-4e6f-968f-a3ee3a775a34 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147" status: 404 len: 111 microversion: 2.1 time: 0.029798 Sep 16 08:15:57.502331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 632/1209] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:15:57 2022] GET /compute/v2.1/servers/2e50a639-a343-4b0e-86fe-9dce43fcc147 => generated 111 bytes in 31 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 08:16:00.811586 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-14e72867-aea6-40dd-be69-62ca300c6f35 req-7bf35fc0-073d-4252-be7f-a9d66a92415f service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "ebeb7134-cf45-40d3-9e5a-b5f9164a8a87", "tag": "423ac706-d95d-479a-86fe-d25bef64dc6a"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:16:00.815253 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-73ef7334-6f4c-4c63-9c63-e81df9afa415 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:16:00.816447 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-73ef7334-6f4c-4c63-9c63-e81df9afa415 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:16:00.828303 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-73ef7334-6f4c-4c63-9c63-e81df9afa415 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:00.832802 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-14e72867-aea6-40dd-be69-62ca300c6f35 req-7bf35fc0-073d-4252-be7f-a9d66a92415f service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:00.833385 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-73ef7334-6f4c-4c63-9c63-e81df9afa415 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:00.833903 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-73ef7334-6f4c-4c63-9c63-e81df9afa415 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.005s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:00.834712 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-73ef7334-6f4c-4c63-9c63-e81df9afa415 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:00.835250 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-73ef7334-6f4c-4c63-9c63-e81df9afa415 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:00.835762 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-73ef7334-6f4c-4c63-9c63-e81df9afa415 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:00.836269 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-14e72867-aea6-40dd-be69-62ca300c6f35 req-7bf35fc0-073d-4252-be7f-a9d66a92415f service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:00.840100 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-14e72867-aea6-40dd-be69-62ca300c6f35 req-7bf35fc0-073d-4252-be7f-a9d66a92415f service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.003s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:00.852196 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-14e72867-aea6-40dd-be69-62ca300c6f35 req-7bf35fc0-073d-4252-be7f-a9d66a92415f service nova] Creating event network-changed:423ac706-d95d-479a-86fe-d25bef64dc6a for instance ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 on hv-cinder-74014 Sep 16 08:16:00.857418 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-14e72867-aea6-40dd-be69-62ca300c6f35 req-7bf35fc0-073d-4252-be7f-a9d66a92415f service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.049353 Sep 16 08:16:00.858279 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 633/1210] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:16:00 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 51 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:16:00.871270 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-73ef7334-6f4c-4c63-9c63-e81df9afa415 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Going to try to terminate instance {{(pid=121047) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:16:00.874137 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:16:01.242578 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-73ef7334-6f4c-4c63-9c63-e81df9afa415 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 204 len: 0 microversion: 2.1 time: 0.438965 Sep 16 08:16:01.243222 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 578/1211] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:16:00 2022] DELETE /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 0 bytes in 441 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:16:01.253238 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-58026af2-3139-434c-97af-f541d5993b26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:16:01.258777 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-58026af2-3139-434c-97af-f541d5993b26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:16:01.265359 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58026af2-3139-434c-97af-f541d5993b26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:01.266055 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58026af2-3139-434c-97af-f541d5993b26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:01.266707 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58026af2-3139-434c-97af-f541d5993b26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:01.267902 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58026af2-3139-434c-97af-f541d5993b26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:01.269782 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58026af2-3139-434c-97af-f541d5993b26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:01.270417 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-58026af2-3139-434c-97af-f541d5993b26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.002s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:01.276112 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=98,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:16:01.418896 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-58026af2-3139-434c-97af-f541d5993b26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:16:01.428445 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-58026af2-3139-434c-97af-f541d5993b26 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1577 microversion: 2.1 time: 0.179378 Sep 16 08:16:01.429159 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 634/1212] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:16:01 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1577 bytes in 181 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:16:02.465016 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-cdb3051b-294d-4c64-80e3-1e0e65d66db9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:16:02.465698 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-cdb3051b-294d-4c64-80e3-1e0e65d66db9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:16:02.472367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cdb3051b-294d-4c64-80e3-1e0e65d66db9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:02.472842 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cdb3051b-294d-4c64-80e3-1e0e65d66db9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:02.473277 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cdb3051b-294d-4c64-80e3-1e0e65d66db9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:02.473961 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cdb3051b-294d-4c64-80e3-1e0e65d66db9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:02.474414 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cdb3051b-294d-4c64-80e3-1e0e65d66db9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:02.474876 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-cdb3051b-294d-4c64-80e3-1e0e65d66db9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:02.658156 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-cdb3051b-294d-4c64-80e3-1e0e65d66db9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:16:02.666467 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-cdb3051b-294d-4c64-80e3-1e0e65d66db9 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1577 microversion: 2.1 time: 0.206091 Sep 16 08:16:02.667093 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 579/1213] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:16:02 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1577 bytes in 208 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:16:03.618945 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-819e3f5c-43c9-46f2-bf63-c466f1fea20a req-bb189889-41e5-40fb-9417-505ef532dda5 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "ebeb7134-cf45-40d3-9e5a-b5f9164a8a87", "name": "network-vif-deleted", "tag": "423ac706-d95d-479a-86fe-d25bef64dc6a"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:16:03.631482 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-819e3f5c-43c9-46f2-bf63-c466f1fea20a req-bb189889-41e5-40fb-9417-505ef532dda5 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:03.631482 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-819e3f5c-43c9-46f2-bf63-c466f1fea20a req-bb189889-41e5-40fb-9417-505ef532dda5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:03.631482 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-819e3f5c-43c9-46f2-bf63-c466f1fea20a req-bb189889-41e5-40fb-9417-505ef532dda5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:03.642031 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-819e3f5c-43c9-46f2-bf63-c466f1fea20a req-bb189889-41e5-40fb-9417-505ef532dda5 service nova] Creating event network-vif-deleted:423ac706-d95d-479a-86fe-d25bef64dc6a for instance ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 on hv-cinder-74014 Sep 16 08:16:03.647453 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-819e3f5c-43c9-46f2-bf63-c466f1fea20a req-bb189889-41e5-40fb-9417-505ef532dda5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.032885 Sep 16 08:16:03.648366 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 635/1214] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:16:03 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 34 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:16:03.690107 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-babbc20a-29fc-4120-809a-3ad0a15d28d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:16:03.691192 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-babbc20a-29fc-4120-809a-3ad0a15d28d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:16:03.697853 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-babbc20a-29fc-4120-809a-3ad0a15d28d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:03.698378 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-babbc20a-29fc-4120-809a-3ad0a15d28d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:03.698934 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-babbc20a-29fc-4120-809a-3ad0a15d28d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:03.699647 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-babbc20a-29fc-4120-809a-3ad0a15d28d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:03.700108 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-babbc20a-29fc-4120-809a-3ad0a15d28d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:03.700545 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-babbc20a-29fc-4120-809a-3ad0a15d28d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:03.766030 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-babbc20a-29fc-4120-809a-3ad0a15d28d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:16:03.774333 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-babbc20a-29fc-4120-809a-3ad0a15d28d0 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1391 microversion: 2.1 time: 0.088058 Sep 16 08:16:03.776574 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 580/1215] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:16:03 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1391 bytes in 89 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:16:04.798446 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:16:04.799151 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:16:04.805305 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:04.805799 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:04.806246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:04.806963 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:04.807429 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:04.807861 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:04.839025 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:04.839511 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:04.839955 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:04.840401 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.objects.instance [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lazy-loading 'fault' on Instance uuid ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 {{(pid=121046) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:16:04.880459 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': 'afbb1d9c9bb34fbd8bfc78710c86d1f5', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '794ad972bfa844538f6f71d62e7bd163', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:16:04.888742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-824ff79f-35aa-4ebe-bd64-067e988c09ea tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 200 len: 1230 microversion: 2.1 time: 0.095087 Sep 16 08:16:04.889303 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 636/1216] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:16:04 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 1230 bytes in 96 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:16:05.912777 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-28117fd0-855c-4426-b4dd-f5fe54a0d712 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:16:05.913422 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-28117fd0-855c-4426-b4dd-f5fe54a0d712 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ebeb7134-cf45-40d3-9e5a-b5f9164a8a87] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:16:05.920012 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28117fd0-855c-4426-b4dd-f5fe54a0d712 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:05.920498 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28117fd0-855c-4426-b4dd-f5fe54a0d712 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:05.920940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28117fd0-855c-4426-b4dd-f5fe54a0d712 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:05.921634 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28117fd0-855c-4426-b4dd-f5fe54a0d712 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:05.922090 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28117fd0-855c-4426-b4dd-f5fe54a0d712 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:05.922521 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-28117fd0-855c-4426-b4dd-f5fe54a0d712 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:05.936236 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-28117fd0-855c-4426-b4dd-f5fe54a0d712 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] HTTP exception thrown: Instance ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 could not be found. Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-28117fd0-855c-4426-b4dd-f5fe54a0d712 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Request method failure captured: Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 HTTP/1.1 Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC7icc78RDqf1g0pn-txuagC1GTaL1aKZB7vktx-XG4uVN4TFTZJJbhJ2s0ZnCqlJ18WLQDJHcKLkofsjUo5J5n9INqsVZBriLM7wME2rxyErmH0YMVll4Vky1wePEf1bJcfZ1cWuQTQd2pVWc1fc3zBXCImrYy9GI2nQgVL9TPhptA Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 794ad972bfa844538f6f71d62e7bd163 Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-TestVolumeBootPattern-541351610 Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:16:05.937871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:16:05.939729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_794ad972bfa844538f6f71d62e7bd163", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:16:05.939729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-TestVolumeBootPattern-541351610 Sep 16 08:16:05.939729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 794ad972bfa844538f6f71d62e7bd163 Sep 16 08:16:05.939729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-TestVolumeBootPattern-541351610 Sep 16 08:16:05.939729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-TestVolumeBootPattern-541351610-project Sep 16 08:16:05.939729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:16:05.939729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:16:05.939729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: afbb1d9c9bb34fbd8bfc78710c86d1f5 Sep 16 08:16:05.939729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-TestVolumeBootPattern-541351610-project Sep 16 08:16:05.939729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:16:05.939729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 could not be found. Sep 16 08:16:05.939729 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': 'ebeb7134-cf45-40d3-9e5a-b5f9164a8a87'} Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 could not be found. Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:16:05.940940 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 could not be found. Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 could not be found. Sep 16 08:16:05.942839 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:16:05.944398 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-28117fd0-855c-4426-b4dd-f5fe54a0d712 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Returning 404 to user: Instance ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:16:05.944398 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-28117fd0-855c-4426-b4dd-f5fe54a0d712 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87" status: 404 len: 111 microversion: 2.1 time: 0.030904 Sep 16 08:16:05.944398 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 581/1217] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:16:05 2022] GET /compute/v2.1/servers/ebeb7134-cf45-40d3-9e5a-b5f9164a8a87 => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:16:06.661341 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ff5a7cdd-ad3f-4bad-ace8-09473aa11688 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:16:06.662388 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ff5a7cdd-ad3f-4bad-ace8-09473aa11688 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:16:06.664857 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=66,nova_api:INSERT=3,nova_api:UPDATE=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:16:06.669502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff5a7cdd-ad3f-4bad-ace8-09473aa11688 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:06.669983 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff5a7cdd-ad3f-4bad-ace8-09473aa11688 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:06.670421 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff5a7cdd-ad3f-4bad-ace8-09473aa11688 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:06.671129 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff5a7cdd-ad3f-4bad-ace8-09473aa11688 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:06.671586 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff5a7cdd-ad3f-4bad-ace8-09473aa11688 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:06.676287 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ff5a7cdd-ad3f-4bad-ace8-09473aa11688 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:06.685751 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-ff5a7cdd-ad3f-4bad-ace8-09473aa11688 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] HTTP exception thrown: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ff5a7cdd-ad3f-4bad-ace8-09473aa11688 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Request method failure captured: Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: DELETE /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d HTTP/1.1 Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJC7icc78RDqf1g0pn-txuagC1GTaL1aKZB7vktx-XG4uVN4TFTZJJbhJ2s0ZnCqlJ18WLQDJHcKLkofsjUo5J5n9INqsVZBriLM7wME2rxyErmH0YMVll4Vky1wePEf1bJcfZ1cWuQTQd2pVWc1fc3zBXCImrYy9GI2nQgVL9TPhptA Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 794ad972bfa844538f6f71d62e7bd163 Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-TestVolumeBootPattern-541351610 Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:16:06.687461 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:16:06.689203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_794ad972bfa844538f6f71d62e7bd163", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:16:06.689203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-TestVolumeBootPattern-541351610 Sep 16 08:16:06.689203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 794ad972bfa844538f6f71d62e7bd163 Sep 16 08:16:06.689203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-TestVolumeBootPattern-541351610 Sep 16 08:16:06.689203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-TestVolumeBootPattern-541351610-project Sep 16 08:16:06.689203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:16:06.689203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:16:06.689203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: afbb1d9c9bb34fbd8bfc78710c86d1f5 Sep 16 08:16:06.689203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-TestVolumeBootPattern-541351610-project Sep 16 08:16:06.689203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:16:06.689203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:16:06.689203 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': 'ea19d9a7-5838-4755-b520-7f6fa0ebde3d'} Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:16:06.690230 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 1095, in delete Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi self._delete(req.environ['nova.context'], req, id) Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 890, in _delete Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server(context, req, instance_uuid) Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:16:06.691764 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:16:06.693437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ff5a7cdd-ad3f-4bad-ace8-09473aa11688 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Returning 404 to user: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:16:06.693437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ff5a7cdd-ad3f-4bad-ace8-09473aa11688 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "DELETE /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 404 len: 111 microversion: 2.1 time: 0.031413 Sep 16 08:16:06.693437 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 637/1218] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:16:06 2022] DELETE /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 111 bytes in 32 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:16:06.697244 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c3935411-846b-4940-bb60-f8782d2f0d89 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:16:06.697849 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c3935411-846b-4940-bb60-f8782d2f0d89 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] [instance: ea19d9a7-5838-4755-b520-7f6fa0ebde3d] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:16:06.703773 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c3935411-846b-4940-bb60-f8782d2f0d89 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:06.704248 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c3935411-846b-4940-bb60-f8782d2f0d89 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:06.704684 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c3935411-846b-4940-bb60-f8782d2f0d89 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:06.705367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c3935411-846b-4940-bb60-f8782d2f0d89 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:16:06.705818 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c3935411-846b-4940-bb60-f8782d2f0d89 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:16:06.706245 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c3935411-846b-4940-bb60-f8782d2f0d89 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:16:06.719848 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.wsgi [None req-c3935411-846b-4940-bb60-f8782d2f0d89 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] HTTP exception thrown: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c3935411-846b-4940-bb60-f8782d2f0d89 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Request method failure captured: Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: request: GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d HTTP/1.1 Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept: application/json Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Accept-Encoding: identity Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Connection: close Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Length: 0 Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Content-Type: application/json Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Host: 10.222.0.59 Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Openstack-System-Scope: None Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: User-Agent: python-urllib3/1.26.12 Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Auth-Token: gAAAAABjJC7icc78RDqf1g0pn-txuagC1GTaL1aKZB7vktx-XG4uVN4TFTZJJbhJ2s0ZnCqlJ18WLQDJHcKLkofsjUo5J5n9INqsVZBriLM7wME2rxyErmH0YMVll4Vky1wePEf1bJcfZ1cWuQTQd2pVWc1fc3zBXCImrYy9GI2nQgVL9TPhptA Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Id: None Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Domain-Name: None Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Identity-Status: Confirmed Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Is-Admin-Project: True Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Id: default Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Domain-Name: Default Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Id: 794ad972bfa844538f6f71d62e7bd163 Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Project-Name: tempest-TestVolumeBootPattern-541351610 Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Role: member,reader Sep 16 08:16:06.721361 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Roles: member,reader Sep 16 08:16:06.723187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_794ad972bfa844538f6f71d62e7bd163", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/794ad972bfa844538f6f71d62e7bd163"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:16:06.723187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant: tempest-TestVolumeBootPattern-541351610 Sep 16 08:16:06.723187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Id: 794ad972bfa844538f6f71d62e7bd163 Sep 16 08:16:06.723187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-Tenant-Name: tempest-TestVolumeBootPattern-541351610 Sep 16 08:16:06.723187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User: tempest-TestVolumeBootPattern-541351610-project Sep 16 08:16:06.723187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Id: default Sep 16 08:16:06.723187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Domain-Name: Default Sep 16 08:16:06.723187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Id: afbb1d9c9bb34fbd8bfc78710c86d1f5 Sep 16 08:16:06.723187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: X-User-Name: tempest-TestVolumeBootPattern-541351610-project Sep 16 08:16:06.723187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: method: > Sep 16 08:16:06.723187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: exception: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:16:06.723187 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: action_args: {'id': 'ea19d9a7-5838-4755-b520-7f6fa0ebde3d'} Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:16:06.724103 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. Sep 16 08:16:06.727166 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: ERROR nova.api.openstack.wsgi Sep 16 08:16:06.728639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c3935411-846b-4940-bb60-f8782d2f0d89 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Returning 404 to user: Instance ea19d9a7-5838-4755-b520-7f6fa0ebde3d could not be found. {{(pid=121047) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:16:06.728639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c3935411-846b-4940-bb60-f8782d2f0d89 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d" status: 404 len: 111 microversion: 2.1 time: 0.029272 Sep 16 08:16:06.728639 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 582/1219] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:16:06 2022] GET /compute/v2.1/servers/ea19d9a7-5838-4755-b520-7f6fa0ebde3d => generated 111 bytes in 30 msecs (HTTP/1.1 404) 9 headers in 379 bytes (2 switches on core 0) Sep 16 08:16:08.196034 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-be329a85-3015-468b-a844-053876071419 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] Calling method '.version_select at 0x7f9d068bc790>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:16:08.278151 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-be329a85-3015-468b-a844-053876071419 tempest-TestVolumeBootPattern-541351610 tempest-TestVolumeBootPattern-541351610-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1882303610" status: 202 len: 0 microversion: 2.1 time: 0.086446 Sep 16 08:16:08.278758 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 638/1220] 10.222.0.59 () {58 vars in 1263 bytes} [Fri Sep 16 08:16:08 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestVolumeBootPattern-1882303610 => generated 0 bytes in 88 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:17:25.607308 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=53,nova_api:UPDATE=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:17:25.608050 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=25,nova_cell1:UPDATE=1,nova_cell1:INSERT=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:17:25.609667 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 08:17:25.609804 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: Fri Sep 16 08:17:25 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764/action (ip 10.222.0.59) !!! Sep 16 08:17:25.614119 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-bd93a693-d83e-438f-afc7-40c099395ddc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Action: 'action', calling method: >, body: {"shelve": {}} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:17:25.614647 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-bd93a693-d83e-438f-afc7-40c099395ddc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:25.621580 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bd93a693-d83e-438f-afc7-40c099395ddc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:25.622056 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bd93a693-d83e-438f-afc7-40c099395ddc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:25.622487 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bd93a693-d83e-438f-afc7-40c099395ddc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:25.623204 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bd93a693-d83e-438f-afc7-40c099395ddc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:25.623656 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bd93a693-d83e-438f-afc7-40c099395ddc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:25.624727 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bd93a693-d83e-438f-afc7-40c099395ddc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:25.647955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-bd93a693-d83e-438f-afc7-40c099395ddc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lazy-loading 'flavor' on Instance uuid 747eb003-d2cb-4458-9c34-b5f64b8ac764 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:17:25.924707 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-bd93a693-d83e-438f-afc7-40c099395ddc tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "POST /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764/action" status: 202 len: 0 microversion: 2.1 time: 0.318997 Sep 16 08:17:25.925297 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 583/1221] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:17:25 2022] POST /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764/action => generated 0 bytes in 320 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:17:25.931490 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=17 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:17:25.937277 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-ab2e4f2a-9202-4914-a12b-064548f06699 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:25.937886 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-ab2e4f2a-9202-4914-a12b-064548f06699 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:25.944631 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab2e4f2a-9202-4914-a12b-064548f06699 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:25.945114 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab2e4f2a-9202-4914-a12b-064548f06699 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:25.945551 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab2e4f2a-9202-4914-a12b-064548f06699 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:25.946248 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab2e4f2a-9202-4914-a12b-064548f06699 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:25.946716 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab2e4f2a-9202-4914-a12b-064548f06699 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:25.947146 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-ab2e4f2a-9202-4914-a12b-064548f06699 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:26.079768 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-ab2e4f2a-9202-4914-a12b-064548f06699 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:26.087501 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-ab2e4f2a-9202-4914-a12b-064548f06699 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.157876 Sep 16 08:17:26.088063 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 639/1222] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:25 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 159 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:27.112987 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-304f2faa-d58c-47b6-9575-d25232fdfe5f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:27.113777 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-304f2faa-d58c-47b6-9575-d25232fdfe5f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:27.119908 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-304f2faa-d58c-47b6-9575-d25232fdfe5f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:27.120386 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-304f2faa-d58c-47b6-9575-d25232fdfe5f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:27.120819 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-304f2faa-d58c-47b6-9575-d25232fdfe5f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:27.121504 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-304f2faa-d58c-47b6-9575-d25232fdfe5f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:27.121955 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-304f2faa-d58c-47b6-9575-d25232fdfe5f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:27.122376 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-304f2faa-d58c-47b6-9575-d25232fdfe5f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:27.255399 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-304f2faa-d58c-47b6-9575-d25232fdfe5f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:27.263152 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-304f2faa-d58c-47b6-9575-d25232fdfe5f tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.155816 Sep 16 08:17:27.263712 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 584/1223] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:27 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:28.287185 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-11607c50-51d5-4a50-8cb9-1a5c8f80dde6 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:28.287805 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-11607c50-51d5-4a50-8cb9-1a5c8f80dde6 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:28.294403 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-11607c50-51d5-4a50-8cb9-1a5c8f80dde6 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:28.294925 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-11607c50-51d5-4a50-8cb9-1a5c8f80dde6 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:28.295369 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-11607c50-51d5-4a50-8cb9-1a5c8f80dde6 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:28.296670 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-11607c50-51d5-4a50-8cb9-1a5c8f80dde6 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:28.297133 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-11607c50-51d5-4a50-8cb9-1a5c8f80dde6 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:28.297567 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-11607c50-51d5-4a50-8cb9-1a5c8f80dde6 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:28.429306 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-11607c50-51d5-4a50-8cb9-1a5c8f80dde6 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:28.437074 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-11607c50-51d5-4a50-8cb9-1a5c8f80dde6 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.153869 Sep 16 08:17:28.437659 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 640/1224] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:28 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:29.459077 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5df7abb6-4667-40e3-9ee0-5e5dcb49e96c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:29.459717 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5df7abb6-4667-40e3-9ee0-5e5dcb49e96c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:29.466229 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5df7abb6-4667-40e3-9ee0-5e5dcb49e96c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:29.466731 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5df7abb6-4667-40e3-9ee0-5e5dcb49e96c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:29.467167 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5df7abb6-4667-40e3-9ee0-5e5dcb49e96c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:29.468448 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5df7abb6-4667-40e3-9ee0-5e5dcb49e96c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:29.468899 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5df7abb6-4667-40e3-9ee0-5e5dcb49e96c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:29.469323 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5df7abb6-4667-40e3-9ee0-5e5dcb49e96c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:29.600372 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5df7abb6-4667-40e3-9ee0-5e5dcb49e96c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:29.608937 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5df7abb6-4667-40e3-9ee0-5e5dcb49e96c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.153174 Sep 16 08:17:29.609542 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 585/1225] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:29 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:30.632787 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a9df52b8-3ffd-4e24-b2b8-aa45a04692ce tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:30.633379 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a9df52b8-3ffd-4e24-b2b8-aa45a04692ce tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:30.640337 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a9df52b8-3ffd-4e24-b2b8-aa45a04692ce tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:30.644710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a9df52b8-3ffd-4e24-b2b8-aa45a04692ce tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:30.644710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a9df52b8-3ffd-4e24-b2b8-aa45a04692ce tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:30.644710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a9df52b8-3ffd-4e24-b2b8-aa45a04692ce tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:30.644710 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a9df52b8-3ffd-4e24-b2b8-aa45a04692ce tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:30.645146 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a9df52b8-3ffd-4e24-b2b8-aa45a04692ce tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:30.773061 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a9df52b8-3ffd-4e24-b2b8-aa45a04692ce tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:30.781081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a9df52b8-3ffd-4e24-b2b8-aa45a04692ce tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.152160 Sep 16 08:17:30.781636 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 641/1226] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:30 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:31.804886 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-bd85344a-0ace-4795-bf28-db900afcee4b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:31.805501 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-bd85344a-0ace-4795-bf28-db900afcee4b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:31.811963 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bd85344a-0ace-4795-bf28-db900afcee4b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:31.812446 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bd85344a-0ace-4795-bf28-db900afcee4b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:31.813453 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bd85344a-0ace-4795-bf28-db900afcee4b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:31.814145 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bd85344a-0ace-4795-bf28-db900afcee4b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:31.814601 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bd85344a-0ace-4795-bf28-db900afcee4b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:31.815057 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-bd85344a-0ace-4795-bf28-db900afcee4b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:31.945992 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-bd85344a-0ace-4795-bf28-db900afcee4b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:31.954268 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-bd85344a-0ace-4795-bf28-db900afcee4b tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.152781 Sep 16 08:17:31.954862 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 586/1227] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:31 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:32.977397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a9bcd9dd-8954-44ea-8a68-457102981c03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:32.978012 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a9bcd9dd-8954-44ea-8a68-457102981c03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:32.984449 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a9bcd9dd-8954-44ea-8a68-457102981c03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:32.984934 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a9bcd9dd-8954-44ea-8a68-457102981c03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:32.985378 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a9bcd9dd-8954-44ea-8a68-457102981c03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:32.986072 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a9bcd9dd-8954-44ea-8a68-457102981c03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:32.986533 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a9bcd9dd-8954-44ea-8a68-457102981c03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:32.986987 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a9bcd9dd-8954-44ea-8a68-457102981c03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:33.116688 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a9bcd9dd-8954-44ea-8a68-457102981c03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:33.124367 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a9bcd9dd-8954-44ea-8a68-457102981c03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.150921 Sep 16 08:17:33.124931 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 642/1228] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:32 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:34.147043 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-6449a7d0-a90d-4d88-9f47-2c40827def34 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:34.147596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-6449a7d0-a90d-4d88-9f47-2c40827def34 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:34.154142 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6449a7d0-a90d-4d88-9f47-2c40827def34 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:34.154620 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6449a7d0-a90d-4d88-9f47-2c40827def34 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:34.155083 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6449a7d0-a90d-4d88-9f47-2c40827def34 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:34.155767 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6449a7d0-a90d-4d88-9f47-2c40827def34 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:34.156213 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6449a7d0-a90d-4d88-9f47-2c40827def34 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:34.157126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-6449a7d0-a90d-4d88-9f47-2c40827def34 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:34.282618 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-6449a7d0-a90d-4d88-9f47-2c40827def34 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:34.290269 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-6449a7d0-a90d-4d88-9f47-2c40827def34 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.147245 Sep 16 08:17:34.290934 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 587/1229] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:34 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 148 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:35.317325 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0c267a31-d937-469a-9021-99b434de4281 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:35.317999 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0c267a31-d937-469a-9021-99b434de4281 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:35.325886 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0c267a31-d937-469a-9021-99b434de4281 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:35.326371 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0c267a31-d937-469a-9021-99b434de4281 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:35.326848 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0c267a31-d937-469a-9021-99b434de4281 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:35.327545 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0c267a31-d937-469a-9021-99b434de4281 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:35.328006 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0c267a31-d937-469a-9021-99b434de4281 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:35.328441 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0c267a31-d937-469a-9021-99b434de4281 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:35.455774 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0c267a31-d937-469a-9021-99b434de4281 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:35.463381 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0c267a31-d937-469a-9021-99b434de4281 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.152263 Sep 16 08:17:35.463943 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 643/1230] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:35 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 153 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:36.487450 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-13e0ca54-8304-4afc-ab72-8f8df88f953e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:36.488077 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-13e0ca54-8304-4afc-ab72-8f8df88f953e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:36.495096 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-13e0ca54-8304-4afc-ab72-8f8df88f953e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:36.495596 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-13e0ca54-8304-4afc-ab72-8f8df88f953e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:36.496041 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-13e0ca54-8304-4afc-ab72-8f8df88f953e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:36.496757 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-13e0ca54-8304-4afc-ab72-8f8df88f953e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:36.497224 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-13e0ca54-8304-4afc-ab72-8f8df88f953e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:36.497657 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-13e0ca54-8304-4afc-ab72-8f8df88f953e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:36.874491 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-13e0ca54-8304-4afc-ab72-8f8df88f953e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:36.882350 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-13e0ca54-8304-4afc-ab72-8f8df88f953e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.399470 Sep 16 08:17:36.882957 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 588/1231] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:36 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 401 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:37.905748 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-0128cc2c-9b9f-448f-8217-b42c9547dd79 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:37.906358 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-0128cc2c-9b9f-448f-8217-b42c9547dd79 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:37.912830 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0128cc2c-9b9f-448f-8217-b42c9547dd79 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:37.913311 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0128cc2c-9b9f-448f-8217-b42c9547dd79 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:37.913745 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0128cc2c-9b9f-448f-8217-b42c9547dd79 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:37.914430 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0128cc2c-9b9f-448f-8217-b42c9547dd79 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:37.914913 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0128cc2c-9b9f-448f-8217-b42c9547dd79 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:37.915339 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-0128cc2c-9b9f-448f-8217-b42c9547dd79 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:38.044737 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-0128cc2c-9b9f-448f-8217-b42c9547dd79 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:38.052638 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-0128cc2c-9b9f-448f-8217-b42c9547dd79 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.150727 Sep 16 08:17:38.053206 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 644/1232] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:37 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:17:39.076021 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-0bd6e975-5f80-441e-9079-e4a5fc9af3ee tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:39.076633 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-0bd6e975-5f80-441e-9079-e4a5fc9af3ee tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:39.083635 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0bd6e975-5f80-441e-9079-e4a5fc9af3ee tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:39.084116 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0bd6e975-5f80-441e-9079-e4a5fc9af3ee tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:39.084551 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0bd6e975-5f80-441e-9079-e4a5fc9af3ee tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:39.085235 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0bd6e975-5f80-441e-9079-e4a5fc9af3ee tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:39.085683 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0bd6e975-5f80-441e-9079-e4a5fc9af3ee tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:39.086110 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-0bd6e975-5f80-441e-9079-e4a5fc9af3ee tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:39.216199 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-0bd6e975-5f80-441e-9079-e4a5fc9af3ee tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:39.224676 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-0bd6e975-5f80-441e-9079-e4a5fc9af3ee tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.152528 Sep 16 08:17:39.225248 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 589/1233] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:39 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:40.247418 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1411616e-b5cf-4138-abd0-cf990758a000 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:40.247978 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1411616e-b5cf-4138-abd0-cf990758a000 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:40.254564 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1411616e-b5cf-4138-abd0-cf990758a000 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:40.255081 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1411616e-b5cf-4138-abd0-cf990758a000 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:40.255524 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1411616e-b5cf-4138-abd0-cf990758a000 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:40.256217 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1411616e-b5cf-4138-abd0-cf990758a000 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:40.256674 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1411616e-b5cf-4138-abd0-cf990758a000 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:40.257102 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1411616e-b5cf-4138-abd0-cf990758a000 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:40.387676 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1411616e-b5cf-4138-abd0-cf990758a000 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:40.396003 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1411616e-b5cf-4138-abd0-cf990758a000 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1569 microversion: 2.1 time: 0.152500 Sep 16 08:17:40.396572 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 645/1234] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:40 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1569 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:40.418991 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-afd6d59f-bda3-4ef0-b554-c2086fa88f56 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Action: 'action', calling method: >, body: {"unshelve": null} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:17:40.419586 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-afd6d59f-bda3-4ef0-b554-c2086fa88f56 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:40.425990 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-afd6d59f-bda3-4ef0-b554-c2086fa88f56 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:40.426462 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-afd6d59f-bda3-4ef0-b554-c2086fa88f56 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:40.426928 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-afd6d59f-bda3-4ef0-b554-c2086fa88f56 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:40.427610 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-afd6d59f-bda3-4ef0-b554-c2086fa88f56 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:40.428095 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-afd6d59f-bda3-4ef0-b554-c2086fa88f56 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:40.428547 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-afd6d59f-bda3-4ef0-b554-c2086fa88f56 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:40.457755 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-afd6d59f-bda3-4ef0-b554-c2086fa88f56 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Unshelving instance with old availability_zone "None" to new availability_zone "not provided" and host "None". {{(pid=121047) unshelve /opt/stack/nova/nova/compute/api.py:4593}} Sep 16 08:17:40.822095 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-afd6d59f-bda3-4ef0-b554-c2086fa88f56 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "POST /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764/action" status: 202 len: 0 microversion: 2.1 time: 0.407169 Sep 16 08:17:40.822734 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 590/1235] 10.222.0.59 () {60 vars in 1278 bytes} [Fri Sep 16 08:17:40 2022] POST /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764/action => generated 0 bytes in 409 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0) Sep 16 08:17:40.830846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2f41c78a-1045-4cde-ae90-eac67756c563 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:40.831457 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2f41c78a-1045-4cde-ae90-eac67756c563 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:40.837625 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2f41c78a-1045-4cde-ae90-eac67756c563 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:40.838110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2f41c78a-1045-4cde-ae90-eac67756c563 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:40.838588 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2f41c78a-1045-4cde-ae90-eac67756c563 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:40.839309 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2f41c78a-1045-4cde-ae90-eac67756c563 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:40.839769 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2f41c78a-1045-4cde-ae90-eac67756c563 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:40.840193 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2f41c78a-1045-4cde-ae90-eac67756c563 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:40.973499 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-2f41c78a-1045-4cde-ae90-eac67756c563 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:40.982184 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2f41c78a-1045-4cde-ae90-eac67756c563 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1517 microversion: 2.1 time: 0.155241 Sep 16 08:17:40.983014 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 646/1236] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:40 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1517 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (2 switches on core 0) Sep 16 08:17:42.007311 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-15bee64e-e053-484c-8de5-c9bc263e6cfd tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:42.007871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-15bee64e-e053-484c-8de5-c9bc263e6cfd tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:42.013908 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-15bee64e-e053-484c-8de5-c9bc263e6cfd tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:42.014398 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-15bee64e-e053-484c-8de5-c9bc263e6cfd tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:42.015009 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-15bee64e-e053-484c-8de5-c9bc263e6cfd tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:42.015719 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-15bee64e-e053-484c-8de5-c9bc263e6cfd tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:42.025576 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-15bee64e-e053-484c-8de5-c9bc263e6cfd tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:42.026125 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-15bee64e-e053-484c-8de5-c9bc263e6cfd tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.010s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:42.168700 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-15bee64e-e053-484c-8de5-c9bc263e6cfd tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:42.176678 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-15bee64e-e053-484c-8de5-c9bc263e6cfd tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1517 microversion: 2.1 time: 0.173744 Sep 16 08:17:42.177257 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 591/1237] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:42 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1517 bytes in 175 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:42.196097 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-83d8070a-0bc0-44b8-85f1-89f6e7c1c4aa req-7f939211-84d4-4ad9-8173-7b1b572ee2a8 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747eb003-d2cb-4458-9c34-b5f64b8ac764", "name": "network-vif-unplugged", "status": "completed", "tag": "ffe6532b-6bcb-4c4c-a9aa-8071554bec05"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:17:42.207807 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-83d8070a-0bc0-44b8-85f1-89f6e7c1c4aa req-7f939211-84d4-4ad9-8173-7b1b572ee2a8 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:42.208322 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-83d8070a-0bc0-44b8-85f1-89f6e7c1c4aa req-7f939211-84d4-4ad9-8173-7b1b572ee2a8 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:42.208765 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-83d8070a-0bc0-44b8-85f1-89f6e7c1c4aa req-7f939211-84d4-4ad9-8173-7b1b572ee2a8 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:42.220918 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.compute.server_external_events [req-83d8070a-0bc0-44b8-85f1-89f6e7c1c4aa req-7f939211-84d4-4ad9-8173-7b1b572ee2a8 service nova] Unable to find a host for instance 747eb003-d2cb-4458-9c34-b5f64b8ac764. Dropping event network-vif-unplugged {{(pid=121046) create /opt/stack/nova/nova/api/openstack/compute/server_external_events.py:144}} Sep 16 08:17:42.221803 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-83d8070a-0bc0-44b8-85f1-89f6e7c1c4aa req-7f939211-84d4-4ad9-8173-7b1b572ee2a8 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 207 len: 182 microversion: 2.1 time: 0.094129 Sep 16 08:17:42.222595 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 647/1238] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:17:42 2022] POST /compute/v2.1/os-server-external-events => generated 182 bytes in 96 msecs (HTTP/1.1 207) 9 headers in 367 bytes (1 switches on core 0) Sep 16 08:17:43.199515 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3750e738-69df-42cd-a4f0-eb8b208a6d1e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:43.200122 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3750e738-69df-42cd-a4f0-eb8b208a6d1e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:43.207250 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3750e738-69df-42cd-a4f0-eb8b208a6d1e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:43.208629 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3750e738-69df-42cd-a4f0-eb8b208a6d1e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:43.208629 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3750e738-69df-42cd-a4f0-eb8b208a6d1e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:43.209091 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3750e738-69df-42cd-a4f0-eb8b208a6d1e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:43.209321 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3750e738-69df-42cd-a4f0-eb8b208a6d1e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:43.209743 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3750e738-69df-42cd-a4f0-eb8b208a6d1e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:43.338376 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3750e738-69df-42cd-a4f0-eb8b208a6d1e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:43.346216 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3750e738-69df-42cd-a4f0-eb8b208a6d1e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1519 microversion: 2.1 time: 0.150522 Sep 16 08:17:43.346797 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 592/1239] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:43 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1519 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:44.370069 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-80113adb-7273-438f-ac6f-8c3f817fba8a tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:44.370713 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-80113adb-7273-438f-ac6f-8c3f817fba8a tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:44.377668 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-80113adb-7273-438f-ac6f-8c3f817fba8a tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:44.378157 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-80113adb-7273-438f-ac6f-8c3f817fba8a tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:44.378594 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-80113adb-7273-438f-ac6f-8c3f817fba8a tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:44.379312 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-80113adb-7273-438f-ac6f-8c3f817fba8a tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:44.379771 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-80113adb-7273-438f-ac6f-8c3f817fba8a tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:44.380198 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-80113adb-7273-438f-ac6f-8c3f817fba8a tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:44.509361 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-80113adb-7273-438f-ac6f-8c3f817fba8a tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:44.517155 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-80113adb-7273-438f-ac6f-8c3f817fba8a tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1575 microversion: 2.1 time: 0.151006 Sep 16 08:17:44.517732 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 648/1240] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:44 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:45.540680 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-c1d2dc01-ef98-4af3-a45b-c1dfbe787b48 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:45.541288 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-c1d2dc01-ef98-4af3-a45b-c1dfbe787b48 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:45.548436 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c1d2dc01-ef98-4af3-a45b-c1dfbe787b48 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:45.548912 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c1d2dc01-ef98-4af3-a45b-c1dfbe787b48 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:45.549345 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c1d2dc01-ef98-4af3-a45b-c1dfbe787b48 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:45.550035 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c1d2dc01-ef98-4af3-a45b-c1dfbe787b48 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:45.550482 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c1d2dc01-ef98-4af3-a45b-c1dfbe787b48 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:45.550945 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-c1d2dc01-ef98-4af3-a45b-c1dfbe787b48 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:45.683519 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-c1d2dc01-ef98-4af3-a45b-c1dfbe787b48 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:45.691762 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-c1d2dc01-ef98-4af3-a45b-c1dfbe787b48 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1575 microversion: 2.1 time: 0.155055 Sep 16 08:17:45.692325 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 593/1241] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:45 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:46.715254 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a0b9c042-a416-45ed-9afb-2a781a7ab0bf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:46.715865 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a0b9c042-a416-45ed-9afb-2a781a7ab0bf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:46.722272 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a0b9c042-a416-45ed-9afb-2a781a7ab0bf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:46.722791 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a0b9c042-a416-45ed-9afb-2a781a7ab0bf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:46.723233 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a0b9c042-a416-45ed-9afb-2a781a7ab0bf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:46.723938 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a0b9c042-a416-45ed-9afb-2a781a7ab0bf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:46.724397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a0b9c042-a416-45ed-9afb-2a781a7ab0bf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:46.724826 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a0b9c042-a416-45ed-9afb-2a781a7ab0bf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:46.852734 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a0b9c042-a416-45ed-9afb-2a781a7ab0bf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:46.860944 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a0b9c042-a416-45ed-9afb-2a781a7ab0bf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1575 microversion: 2.1 time: 0.149608 Sep 16 08:17:46.861502 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 649/1242] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:46 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:47.883261 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5b5c2a6c-0a08-4dd0-a88f-168b63290b31 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:47.883871 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5b5c2a6c-0a08-4dd0-a88f-168b63290b31 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:47.890367 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b5c2a6c-0a08-4dd0-a88f-168b63290b31 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:47.891581 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b5c2a6c-0a08-4dd0-a88f-168b63290b31 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:47.891991 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b5c2a6c-0a08-4dd0-a88f-168b63290b31 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:47.892674 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b5c2a6c-0a08-4dd0-a88f-168b63290b31 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:47.893130 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b5c2a6c-0a08-4dd0-a88f-168b63290b31 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:47.893553 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b5c2a6c-0a08-4dd0-a88f-168b63290b31 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:48.022709 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5b5c2a6c-0a08-4dd0-a88f-168b63290b31 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:48.030653 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5b5c2a6c-0a08-4dd0-a88f-168b63290b31 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1575 microversion: 2.1 time: 0.151282 Sep 16 08:17:48.031241 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 594/1243] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:47 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:49.053818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-503c3851-0609-4269-83d4-4e4c77d93009 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:49.054394 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-503c3851-0609-4269-83d4-4e4c77d93009 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:49.061111 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-503c3851-0609-4269-83d4-4e4c77d93009 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:49.061605 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-503c3851-0609-4269-83d4-4e4c77d93009 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:49.062052 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-503c3851-0609-4269-83d4-4e4c77d93009 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:49.062778 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-503c3851-0609-4269-83d4-4e4c77d93009 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:49.063743 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-503c3851-0609-4269-83d4-4e4c77d93009 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:49.064178 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-503c3851-0609-4269-83d4-4e4c77d93009 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:49.196604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-503c3851-0609-4269-83d4-4e4c77d93009 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:49.205176 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-503c3851-0609-4269-83d4-4e4c77d93009 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1575 microversion: 2.1 time: 0.155357 Sep 16 08:17:49.205748 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 650/1244] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:49 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1575 bytes in 157 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:50.228666 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-3b8250ca-4000-4e35-8cc1-1bc2d79755f3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:50.229272 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-3b8250ca-4000-4e35-8cc1-1bc2d79755f3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:50.236180 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b8250ca-4000-4e35-8cc1-1bc2d79755f3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:50.236654 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b8250ca-4000-4e35-8cc1-1bc2d79755f3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:50.237090 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b8250ca-4000-4e35-8cc1-1bc2d79755f3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:50.237772 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b8250ca-4000-4e35-8cc1-1bc2d79755f3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:50.238225 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b8250ca-4000-4e35-8cc1-1bc2d79755f3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:50.238646 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-3b8250ca-4000-4e35-8cc1-1bc2d79755f3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:50.367858 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-3b8250ca-4000-4e35-8cc1-1bc2d79755f3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:50.375822 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-3b8250ca-4000-4e35-8cc1-1bc2d79755f3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1575 microversion: 2.1 time: 0.151117 Sep 16 08:17:50.376447 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 595/1245] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:50 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:51.399678 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-8ed4525b-cb9f-4eee-ad63-38df01981fe0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:51.400331 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-8ed4525b-cb9f-4eee-ad63-38df01981fe0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:51.407348 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ed4525b-cb9f-4eee-ad63-38df01981fe0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:51.407818 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ed4525b-cb9f-4eee-ad63-38df01981fe0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:51.408259 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ed4525b-cb9f-4eee-ad63-38df01981fe0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:51.408963 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ed4525b-cb9f-4eee-ad63-38df01981fe0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:51.409422 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ed4525b-cb9f-4eee-ad63-38df01981fe0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:51.410150 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-8ed4525b-cb9f-4eee-ad63-38df01981fe0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:51.538497 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-8ed4525b-cb9f-4eee-ad63-38df01981fe0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:51.546246 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-8ed4525b-cb9f-4eee-ad63-38df01981fe0 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1575 microversion: 2.1 time: 0.150742 Sep 16 08:17:51.546816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 651/1246] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:51 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:52.569449 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-5b297cac-ed0f-4f3c-bca7-47d37a00c700 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:52.570113 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-5b297cac-ed0f-4f3c-bca7-47d37a00c700 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:52.576701 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b297cac-ed0f-4f3c-bca7-47d37a00c700 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:52.580126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b297cac-ed0f-4f3c-bca7-47d37a00c700 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:52.580126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b297cac-ed0f-4f3c-bca7-47d37a00c700 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:52.580126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b297cac-ed0f-4f3c-bca7-47d37a00c700 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:52.580126 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b297cac-ed0f-4f3c-bca7-47d37a00c700 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:52.580532 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-5b297cac-ed0f-4f3c-bca7-47d37a00c700 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:52.596734 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=95,nova_cell1:UPDATE=3,nova_cell1:INSERT=2 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:17:52.707395 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-5b297cac-ed0f-4f3c-bca7-47d37a00c700 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:52.715503 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-5b297cac-ed0f-4f3c-bca7-47d37a00c700 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1575 microversion: 2.1 time: 0.150563 Sep 16 08:17:52.725698 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 596/1247] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:52 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1575 bytes in 152 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:53.738667 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-dea25756-6a8b-4bd6-a11a-695008680899 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:53.739316 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-dea25756-6a8b-4bd6-a11a-695008680899 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:53.745753 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dea25756-6a8b-4bd6-a11a-695008680899 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:53.746235 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dea25756-6a8b-4bd6-a11a-695008680899 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:53.746816 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dea25756-6a8b-4bd6-a11a-695008680899 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:53.747510 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dea25756-6a8b-4bd6-a11a-695008680899 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:53.747967 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dea25756-6a8b-4bd6-a11a-695008680899 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:53.748397 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-dea25756-6a8b-4bd6-a11a-695008680899 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:53.880103 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-dea25756-6a8b-4bd6-a11a-695008680899 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:53.887831 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-dea25756-6a8b-4bd6-a11a-695008680899 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1575 microversion: 2.1 time: 0.153158 Sep 16 08:17:53.888400 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 652/1248] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:53 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1575 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:54.912687 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-8e502400-72b6-4db0-92e7-22a8b1e33135 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:54.913226 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-8e502400-72b6-4db0-92e7-22a8b1e33135 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:54.919896 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8e502400-72b6-4db0-92e7-22a8b1e33135 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:54.920381 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8e502400-72b6-4db0-92e7-22a8b1e33135 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:54.920819 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8e502400-72b6-4db0-92e7-22a8b1e33135 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:54.921512 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8e502400-72b6-4db0-92e7-22a8b1e33135 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:54.921968 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8e502400-72b6-4db0-92e7-22a8b1e33135 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:54.922399 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-8e502400-72b6-4db0-92e7-22a8b1e33135 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:55.054423 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-8e502400-72b6-4db0-92e7-22a8b1e33135 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:55.062329 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-8e502400-72b6-4db0-92e7-22a8b1e33135 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1575 microversion: 2.1 time: 0.154646 Sep 16 08:17:55.062931 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 597/1249] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:54 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1575 bytes in 156 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:56.086032 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-c0f3d843-979f-4c84-8daa-2008dcd4f526 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:56.086580 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-c0f3d843-979f-4c84-8daa-2008dcd4f526 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:56.088922 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=33,nova_api:DELETE=1 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:17:56.093594 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c0f3d843-979f-4c84-8daa-2008dcd4f526 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:56.094082 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c0f3d843-979f-4c84-8daa-2008dcd4f526 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:56.094525 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c0f3d843-979f-4c84-8daa-2008dcd4f526 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:56.095244 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c0f3d843-979f-4c84-8daa-2008dcd4f526 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:56.095709 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c0f3d843-979f-4c84-8daa-2008dcd4f526 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:56.096137 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-c0f3d843-979f-4c84-8daa-2008dcd4f526 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:56.098652 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=81 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:17:56.227858 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-c0f3d843-979f-4c84-8daa-2008dcd4f526 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:56.235535 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-c0f3d843-979f-4c84-8daa-2008dcd4f526 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1575 microversion: 2.1 time: 0.153457 Sep 16 08:17:56.236104 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 653/1250] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:56 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1575 bytes in 155 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:56.261318 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-96183036-5ef7-4d79-908a-409f52574e63 req-551a0a2b-88a9-4585-b5d4-1eeb1cf9da86 service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747eb003-d2cb-4458-9c34-b5f64b8ac764", "name": "network-vif-plugged", "status": "completed", "tag": "ffe6532b-6bcb-4c4c-a9aa-8071554bec05"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:17:56.266878 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=35,nova_api:UPDATE=1 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:17:56.271965 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-96183036-5ef7-4d79-908a-409f52574e63 req-551a0a2b-88a9-4585-b5d4-1eeb1cf9da86 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:56.272444 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-96183036-5ef7-4d79-908a-409f52574e63 req-551a0a2b-88a9-4585-b5d4-1eeb1cf9da86 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:56.272879 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-96183036-5ef7-4d79-908a-409f52574e63 req-551a0a2b-88a9-4585-b5d4-1eeb1cf9da86 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:56.286431 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-96183036-5ef7-4d79-908a-409f52574e63 req-551a0a2b-88a9-4585-b5d4-1eeb1cf9da86 service nova] Creating event network-vif-plugged:ffe6532b-6bcb-4c4c-a9aa-8071554bec05 for instance 747eb003-d2cb-4458-9c34-b5f64b8ac764 on hv-cinder-74014 Sep 16 08:17:56.291557 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-96183036-5ef7-4d79-908a-409f52574e63 req-551a0a2b-88a9-4585-b5d4-1eeb1cf9da86 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.033933 Sep 16 08:17:56.292136 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 598/1251] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:17:56 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 35 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:17:57.259594 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-a6ba6862-4115-4ab8-8c16-84783b6bc8b9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:57.260204 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-a6ba6862-4115-4ab8-8c16-84783b6bc8b9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:57.266585 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a6ba6862-4115-4ab8-8c16-84783b6bc8b9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:57.267115 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a6ba6862-4115-4ab8-8c16-84783b6bc8b9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:57.268060 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a6ba6862-4115-4ab8-8c16-84783b6bc8b9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:57.268781 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a6ba6862-4115-4ab8-8c16-84783b6bc8b9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:57.269241 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a6ba6862-4115-4ab8-8c16-84783b6bc8b9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:57.269669 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-a6ba6862-4115-4ab8-8c16-84783b6bc8b9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:57.397209 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-a6ba6862-4115-4ab8-8c16-84783b6bc8b9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:57.405265 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-a6ba6862-4115-4ab8-8c16-84783b6bc8b9 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1575 microversion: 2.1 time: 0.149552 Sep 16 08:17:57.405830 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 654/1252] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:57 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1575 bytes in 151 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:17:58.429096 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-253fe8b1-e0b1-4857-b9df-28c71657db03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:17:58.433937 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-253fe8b1-e0b1-4857-b9df-28c71657db03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:17:58.436538 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-253fe8b1-e0b1-4857-b9df-28c71657db03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:58.437021 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-253fe8b1-e0b1-4857-b9df-28c71657db03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:58.437462 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-253fe8b1-e0b1-4857-b9df-28c71657db03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:58.438154 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-253fe8b1-e0b1-4857-b9df-28c71657db03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:17:58.438614 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-253fe8b1-e0b1-4857-b9df-28c71657db03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:17:58.439071 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-253fe8b1-e0b1-4857-b9df-28c71657db03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:17:58.568601 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-253fe8b1-e0b1-4857-b9df-28c71657db03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:17:58.576324 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-253fe8b1-e0b1-4857-b9df-28c71657db03 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1562 microversion: 2.1 time: 0.152159 Sep 16 08:17:58.576885 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 599/1253] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:17:58 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1562 bytes in 154 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:19:13.168085 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_api:SELECT=3 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:19:13.169131 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG dbcounter [-] [121046] Writing DB stats nova_cell1:SELECT=11 {{(pid=121046) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:19:13.170103 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 08:19:13.170339 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Fri Sep 16 08:19:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 (ip 10.222.0.59) !!! Sep 16 08:19:13.171625 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 08:19:13.171984 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Fri Sep 16 08:19:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 (ip 10.222.0.59) !!! Sep 16 08:19:13.172982 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO oslo.messaging._drivers.impl_rabbit [-] A recoverable connection/channel error occurred, trying to reconnect: [Errno 104] Connection reset by peer Sep 16 08:19:13.173323 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Fri Sep 16 08:19:13 2022 - SIGPIPE: writing to a closed pipe/socket/fd (probably the client disconnected) on request /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 (ip 10.222.0.59) !!! Sep 16 08:19:13.173806 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_api:SELECT=3 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:19:13.174545 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG dbcounter [-] [121047] Writing DB stats nova_cell1:SELECT=16 {{(pid=121047) stat_writer /usr/local/lib/python3.8/dist-packages/dbcounter.py:114}} Sep 16 08:19:13.181739 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-2b30db79-ac95-487f-8105-7a209eb2965c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:19:13.181739 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2b30db79-ac95-487f-8105-7a209eb2965c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:19:13.193050 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b30db79-ac95-487f-8105-7a209eb2965c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:13.193685 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b30db79-ac95-487f-8105-7a209eb2965c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:13.194353 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b30db79-ac95-487f-8105-7a209eb2965c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:13.195336 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b30db79-ac95-487f-8105-7a209eb2965c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:13.196005 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b30db79-ac95-487f-8105-7a209eb2965c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:13.196604 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-2b30db79-ac95-487f-8105-7a209eb2965c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:13.227525 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-2b30db79-ac95-487f-8105-7a209eb2965c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Going to try to terminate instance {{(pid=121046) delete /opt/stack/nova/nova/compute/api.py:2719}} Sep 16 08:19:13.249797 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [req-22434afa-22ba-46d5-a319-e74d7608dcf1 req-245e279b-a510-4c11-a8cd-04bb5b915ab5 service nova] Action: 'create', calling method: >, body: {"events": [{"name": "network-changed", "server_uuid": "747eb003-d2cb-4458-9c34-b5f64b8ac764", "tag": "ffe6532b-6bcb-4c4c-a9aa-8071554bec05"}]} {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:19:13.259559 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-22434afa-22ba-46d5-a319-e74d7608dcf1 req-245e279b-a510-4c11-a8cd-04bb5b915ab5 service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:13.260385 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-22434afa-22ba-46d5-a319-e74d7608dcf1 req-245e279b-a510-4c11-a8cd-04bb5b915ab5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:13.260923 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [req-22434afa-22ba-46d5-a319-e74d7608dcf1 req-245e279b-a510-4c11-a8cd-04bb5b915ab5 service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:13.273701 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.compute.server_external_events [req-22434afa-22ba-46d5-a319-e74d7608dcf1 req-245e279b-a510-4c11-a8cd-04bb5b915ab5 service nova] Creating event network-changed:ffe6532b-6bcb-4c4c-a9aa-8071554bec05 for instance 747eb003-d2cb-4458-9c34-b5f64b8ac764 on hv-cinder-74014 Sep 16 08:19:13.279052 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [req-22434afa-22ba-46d5-a319-e74d7608dcf1 req-245e279b-a510-4c11-a8cd-04bb5b915ab5 service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 179 microversion: 2.1 time: 0.110566 Sep 16 08:19:13.279686 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 600/1254] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:19:13 2022] POST /compute/v2.1/os-server-external-events => generated 179 bytes in 112 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:19:13.451742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-2b30db79-ac95-487f-8105-7a209eb2965c tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "DELETE /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 204 len: 0 microversion: 2.1 time: 0.283160 Sep 16 08:19:13.452343 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 655/1255] 10.222.0.59 () {58 vars in 1239 bytes} [Fri Sep 16 08:19:13 2022] DELETE /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 0 bytes in 287 msecs (HTTP/1.1 204) 9 headers in 363 bytes (1 switches on core 0) Sep 16 08:19:13.463127 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-583e0b31-b5eb-4fcd-9577-b1f455c15c9e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:19:13.464078 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-583e0b31-b5eb-4fcd-9577-b1f455c15c9e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:19:13.471489 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-583e0b31-b5eb-4fcd-9577-b1f455c15c9e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:13.472347 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-583e0b31-b5eb-4fcd-9577-b1f455c15c9e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:13.473245 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-583e0b31-b5eb-4fcd-9577-b1f455c15c9e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:13.474210 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-583e0b31-b5eb-4fcd-9577-b1f455c15c9e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:13.474911 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-583e0b31-b5eb-4fcd-9577-b1f455c15c9e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:13.475600 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-583e0b31-b5eb-4fcd-9577-b1f455c15c9e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:13.613085 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-583e0b31-b5eb-4fcd-9577-b1f455c15c9e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:19:13.620778 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-583e0b31-b5eb-4fcd-9577-b1f455c15c9e tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.162922 Sep 16 08:19:13.621396 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 601/1256] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:19:13 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 165 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:19:14.645355 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-1b43cab7-636d-42ad-ade4-d7f4c59e81a3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:19:14.646049 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-1b43cab7-636d-42ad-ade4-d7f4c59e81a3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:19:14.653042 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1b43cab7-636d-42ad-ade4-d7f4c59e81a3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:14.653872 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1b43cab7-636d-42ad-ade4-d7f4c59e81a3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:14.654940 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1b43cab7-636d-42ad-ade4-d7f4c59e81a3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:14.655654 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1b43cab7-636d-42ad-ade4-d7f4c59e81a3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:14.656110 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1b43cab7-636d-42ad-ade4-d7f4c59e81a3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:14.656535 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-1b43cab7-636d-42ad-ade4-d7f4c59e81a3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:14.789153 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.policy [None req-1b43cab7-636d-42ad-ade4-d7f4c59e81a3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121046) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:19:14.797705 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-1b43cab7-636d-42ad-ade4-d7f4c59e81a3 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1568 microversion: 2.1 time: 0.156523 Sep 16 08:19:14.798266 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 656/1257] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:19:14 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1568 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:19:15.821158 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-dd742789-458d-4aa1-83a1-550362fa2acf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:19:15.821777 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-dd742789-458d-4aa1-83a1-550362fa2acf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:19:15.828975 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dd742789-458d-4aa1-83a1-550362fa2acf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:15.829464 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dd742789-458d-4aa1-83a1-550362fa2acf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:15.829910 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dd742789-458d-4aa1-83a1-550362fa2acf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:15.830617 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dd742789-458d-4aa1-83a1-550362fa2acf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:15.831105 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dd742789-458d-4aa1-83a1-550362fa2acf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:15.831565 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-dd742789-458d-4aa1-83a1-550362fa2acf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:15.964431 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-dd742789-458d-4aa1-83a1-550362fa2acf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:19:15.973723 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-dd742789-458d-4aa1-83a1-550362fa2acf tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1449 microversion: 2.1 time: 0.156526 Sep 16 08:19:15.974636 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 602/1258] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:19:15 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1449 bytes in 158 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:19:16.036574 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [req-dd24af29-aad6-4aac-b435-615db8226a22 req-354200c1-e5be-4230-9a23-04f7b111147b service nova] Action: 'create', calling method: >, body: {"events": [{"server_uuid": "747eb003-d2cb-4458-9c34-b5f64b8ac764", "name": "network-vif-deleted", "tag": "ffe6532b-6bcb-4c4c-a9aa-8071554bec05"}]} {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:511}} Sep 16 08:19:16.046457 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-dd24af29-aad6-4aac-b435-615db8226a22 req-354200c1-e5be-4230-9a23-04f7b111147b service nova] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:16.046971 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-dd24af29-aad6-4aac-b435-615db8226a22 req-354200c1-e5be-4230-9a23-04f7b111147b service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:16.047411 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [req-dd24af29-aad6-4aac-b435-615db8226a22 req-354200c1-e5be-4230-9a23-04f7b111147b service nova] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:16.058231 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.compute.server_external_events [req-dd24af29-aad6-4aac-b435-615db8226a22 req-354200c1-e5be-4230-9a23-04f7b111147b service nova] Creating event network-vif-deleted:ffe6532b-6bcb-4c4c-a9aa-8071554bec05 for instance 747eb003-d2cb-4458-9c34-b5f64b8ac764 on hv-cinder-74014 Sep 16 08:19:16.063303 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [req-dd24af29-aad6-4aac-b435-615db8226a22 req-354200c1-e5be-4230-9a23-04f7b111147b service nova] 10.222.0.59 "POST /compute/v2.1/os-server-external-events" status: 200 len: 183 microversion: 2.1 time: 0.030416 Sep 16 08:19:16.063889 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 657/1259] 10.222.0.59 () {64 vars in 1317 bytes} [Fri Sep 16 08:19:16 2022] POST /compute/v2.1/os-server-external-events => generated 183 bytes in 32 msecs (HTTP/1.1 200) 9 headers in 357 bytes (1 switches on core 0) Sep 16 08:19:16.997022 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:19:16.998285 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.compute.api [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121047) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:19:17.005099 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:17.008234 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:17.008234 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:17.008234 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:17.008234 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:17.008705 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:17.039904 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:17.040382 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:17.040817 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG oslo_concurrency.lockutils [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121047) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:17.041355 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.objects.instance [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lazy-loading 'fault' on Instance uuid 747eb003-d2cb-4458-9c34-b5f64b8ac764 {{(pid=121047) obj_load_attr /opt/stack/nova/nova/objects/instance.py:1100}} Sep 16 08:19:17.084518 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.policy [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Policy check for os_compute_api:os-extended-server-attributes failed with credentials {'is_admin': False, 'user_id': '032d96be1a1146069299d83919adf7ce', 'user_domain_id': 'default', 'system_scope': None, 'domain_id': None, 'project_id': '715b5f5887c940aca9d81291d48fd426', 'project_domain_id': 'default', 'roles': ['member', 'reader'], 'is_admin_project': True, 'service_user_id': None, 'service_user_domain_id': None, 'service_project_id': None, 'service_project_domain_id': None, 'service_roles': []} {{(pid=121047) authorize /opt/stack/nova/nova/policy.py:199}} Sep 16 08:19:17.093007 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-9be35eee-81cd-41e5-a317-75c77f2ccff4 tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 200 len: 1224 microversion: 2.1 time: 0.099957 Sep 16 08:19:17.093578 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 603/1260] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:19:16 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 1224 bytes in 101 msecs (HTTP/1.1 200) 9 headers in 358 bytes (1 switches on core 0) Sep 16 08:19:18.118219 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-27698f88-0b2d-4e99-a7bf-b1229a7a8ead tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '>' {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:19:18.118863 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.compute.api [None req-27698f88-0b2d-4e99-a7bf-b1229a7a8ead tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] [instance: 747eb003-d2cb-4458-9c34-b5f64b8ac764] Fetching instance by UUID {{(pid=121046) get /opt/stack/nova/nova/compute/api.py:2975}} Sep 16 08:19:18.125655 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27698f88-0b2d-4e99-a7bf-b1229a7a8ead tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:18.126136 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27698f88-0b2d-4e99-a7bf-b1229a7a8ead tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.001s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:18.126575 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27698f88-0b2d-4e99-a7bf-b1229a7a8ead tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:18.127288 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27698f88-0b2d-4e99-a7bf-b1229a7a8ead tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Acquiring lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:404}} Sep 16 08:19:18.127742 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27698f88-0b2d-4e99-a7bf-b1229a7a8ead tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" acquired by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: waited 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:409}} Sep 16 08:19:18.128166 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG oslo_concurrency.lockutils [None req-27698f88-0b2d-4e99-a7bf-b1229a7a8ead tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Lock "5d2a7ab0-3154-4bb4-b1ae-2119c6fd3e43" "released" by "nova.context.set_target_cell..get_or_set_cached_cell_and_set_connections" :: held 0.000s {{(pid=121046) inner /usr/local/lib/python3.8/dist-packages/oslo_concurrency/lockutils.py:423}} Sep 16 08:19:18.141846 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.wsgi [None req-27698f88-0b2d-4e99-a7bf-b1229a7a8ead tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] HTTP exception thrown: Instance 747eb003-d2cb-4458-9c34-b5f64b8ac764 could not be found. Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-27698f88-0b2d-4e99-a7bf-b1229a7a8ead tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Request method failure captured: Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: request: GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 HTTP/1.1 Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept: application/json Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Accept-Encoding: identity Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Connection: close Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Length: 0 Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Content-Type: application/json Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Host: 10.222.0.59 Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: Openstack-System-Scope: None Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: User-Agent: python-urllib3/1.26.12 Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Auth-Token: gAAAAABjJDBmRQMD2G6PBZCEtuonUSC3quXKt_Jpu43yBfygYNyXrlg-kM648p-yAH546TCyNIy47WECGW9nBngujOxb_pR-028pKTpr6ckqeJtGW98vIsMiRLGgxbEDPFJCrIy11iOlgrKrR5esZrgcgkpnlTO2N4WNpYobmQeiDYARYXj8HyY Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Id: None Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Domain-Name: None Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Identity-Status: Confirmed Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Is-Admin-Project: True Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Id: default Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Domain-Name: Default Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Id: 715b5f5887c940aca9d81291d48fd426 Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Project-Name: tempest-TestShelveInstance-862690332 Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Role: member,reader Sep 16 08:19:18.143563 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Roles: member,reader Sep 16 08:19:18.145562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Service-Catalog: [{"type": "identity", "name": "keystone", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/identity"}]}, {"type": "volumev3", "name": "cinderv3", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/715b5f5887c940aca9d81291d48fd426"}]}, {"type": "image", "name": "glance", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/image"}]}, {"type": "compute_legacy", "name": "nova_legacy", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2/715b5f5887c940aca9d81291d48fd426"}]}, {"type": "object-store", "name": "swift", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:8080/v1/AUTH_715b5f5887c940aca9d81291d48fd426", "adminURL": "http://10.222.0.59:8080"}]}, {"type": "network", "name": "neutron", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59:9696/networking"}]}, {"type": "block-storage", "name": "cinder", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/volume/v3/715b5f5887c940aca9d81291d48fd426"}]}, {"type": "compute", "name": "nova", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/compute/v2.1"}]}, {"type": "placement", "name": "placement", "endpoints": [{"region": "RegionOne", "publicURL": "http://10.222.0.59/placement"}]}] Sep 16 08:19:18.145562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant: tempest-TestShelveInstance-862690332 Sep 16 08:19:18.145562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Id: 715b5f5887c940aca9d81291d48fd426 Sep 16 08:19:18.145562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-Tenant-Name: tempest-TestShelveInstance-862690332 Sep 16 08:19:18.145562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User: tempest-TestShelveInstance-862690332-project Sep 16 08:19:18.145562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Id: default Sep 16 08:19:18.145562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Domain-Name: Default Sep 16 08:19:18.145562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Id: 032d96be1a1146069299d83919adf7ce Sep 16 08:19:18.145562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: X-User-Name: tempest-TestShelveInstance-862690332-project Sep 16 08:19:18.145562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: method: > Sep 16 08:19:18.145562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: exception: Instance 747eb003-d2cb-4458-9c34-b5f64b8ac764 could not be found. Sep 16 08:19:18.145562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: action_args: {'id': '747eb003-d2cb-4458-9c34-b5f64b8ac764'} Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: {{(pid=121046) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:541}} Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 468, in get_instance Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return compute_api.get(context, instance_id, Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2978, in get Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance(context, instance_id, Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2925, in _get_instance Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_instance_from_cell(context, inst_map, Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/compute/api.py", line 2882, in _get_instance_from_cell Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exception.InstanceNotFound(instance_id=uuid) Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.exception.InstanceNotFound: Instance 747eb003-d2cb-4458-9c34-b5f64b8ac764 could not be found. Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 630, in dispatch Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return method(req=request, **action_args) Sep 16 08:19:18.147113 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 664, in wrapped Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi return f(*args, **kwargs) Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 470, in show Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = self._get_server( Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/compute/servers.py", line 376, in _get_server Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi instance = common.get_instance(self.compute_api, context, Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/common.py", line 472, in get_instance Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise exc.HTTPNotFound(explanation=e.format_message()) Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi webob.exc.HTTPNotFound: Instance 747eb003-d2cb-4458-9c34-b5f64b8ac764 could not be found. Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi During handling of the above exception, another exception occurred: Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Traceback (most recent call last): Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 539, in _process_stack Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi action_result = self.dispatch(meth, request, action_args) Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi File "/opt/stack/nova/nova/api/openstack/wsgi.py", line 372, in __exit__ Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi raise Fault(ex_value) Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi nova.api.openstack.wsgi.Fault: Instance 747eb003-d2cb-4458-9c34-b5f64b8ac764 could not be found. Sep 16 08:19:18.148980 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: ERROR nova.api.openstack.wsgi Sep 16 08:19:18.150562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: DEBUG nova.api.openstack.wsgi [None req-27698f88-0b2d-4e99-a7bf-b1229a7a8ead tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Returning 404 to user: Instance 747eb003-d2cb-4458-9c34-b5f64b8ac764 could not be found. {{(pid=121046) __call__ /opt/stack/nova/nova/api/openstack/wsgi.py:942}} Sep 16 08:19:18.150562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: INFO nova.api.openstack.requestlog [None req-27698f88-0b2d-4e99-a7bf-b1229a7a8ead tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764" status: 404 len: 111 microversion: 2.1 time: 0.031765 Sep 16 08:19:18.150562 dv-cinder-740146-20-iscsi devstack@n-api.service[121046]: [pid: 121046|app: 0|req: 658/1261] 10.222.0.59 () {58 vars in 1236 bytes} [Fri Sep 16 08:19:18 2022] GET /compute/v2.1/servers/747eb003-d2cb-4458-9c34-b5f64b8ac764 => generated 111 bytes in 33 msecs (HTTP/1.1 404) 9 headers in 379 bytes (1 switches on core 0) Sep 16 08:19:18.358893 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: DEBUG nova.api.openstack.wsgi [None req-923f7b56-d4be-4ef2-9d0d-c7bd2e25ffef tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] Calling method '.version_select at 0x7f9d0684d820>' {{(pid=121047) _process_stack /opt/stack/nova/nova/api/openstack/wsgi.py:513}} Sep 16 08:19:18.418151 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: INFO nova.api.openstack.requestlog [None req-923f7b56-d4be-4ef2-9d0d-c7bd2e25ffef tempest-TestShelveInstance-862690332 tempest-TestShelveInstance-862690332-project] 10.222.0.59 "DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-262311822" status: 202 len: 0 microversion: 2.1 time: 0.063602 Sep 16 08:19:18.418767 dv-cinder-740146-20-iscsi devstack@n-api.service[121047]: [pid: 121047|app: 0|req: 604/1262] 10.222.0.59 () {58 vars in 1251 bytes} [Fri Sep 16 08:19:18 2022] DELETE /compute/v2.1/os-keypairs/tempest-TestShelveInstance-262311822 => generated 0 bytes in 65 msecs (HTTP/1.1 202) 9 headers in 361 bytes (1 switches on core 0)